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SUBSTITUTE SPECIFICATION 

NETWORK CONTROL SYSTEM 

TECHNICAL FIELD 

[0001] The present invention relates to network control systems in which a device connected to a 
network is operated through a network and, more specifically, a device control system with a 
graphical user interface (GUI) supporting user's device operation through graphics, characters, etc., 
on a screen. 

BACKGROUND ART 

[0002] In recent years, device control systems for controlling devices by selectively operating, 
through a remote controller, device control graphics (icons) composed of screen display data and 
characters indicating functions of the devices on a TV (Television) screen have made their 
appearance. Also, network systems with digital devices such as a DVD connected thereto using IEEE 
1394-1995 for transmitting and receiving video/audio data have been emerging. 
[0003] One example of conventional network control systems is disclosed in Japanese Patent 
Laying-Open No,H9-149325 (1997-149325). 

[0004] This conventional network control system is now described below. 
[0005] Similarly to digital interfaces according to IEEE 1 394 standards, etc., AV units are connected 
to each other without switching by a bilateral packet communications system with a serial bus that 
periodically provides an equal communication opportunity to the devices. 

[0006] Here, each AV unit stores its own screen display data. By request from a controller having 
a graphic display function (television receiver), each AV unit transmits the screen display data to the 
controller. The controller displays the received screen display data. The controller further has the 
functions of inquiring for data required for indicating the AV unit connected thereto and controlling 
the display screen based on the screen display data from the AV unit. Each AV unit has a recording 
medium for storing the screen display data, and a function of selecting the appropriate screen display 
data in response to the inquiry from the controller for the screen display data. 
[0007] In the above structured network control system, the screen display data is held in each device 
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(AV unit), and outputted according to a display request from the controller (television receiver). 
Graphics unique to each device (AV unit) are thus displayed on the screen of the controller. 
[0008] In the above described structure, however, when the display on an operating screen is to be 
changed due to internal state changes in the device, the device cannot report its change of state to the 
controller, thereby causing a mismatch in display screen information between the controller and the 
device. For this reason, the controller cannot correctly provide a user with device operation 
information. 

[0009] In view of the above problem, an object of the present invention is to provide a network 
control system in which a device can quickly report to a controller about a change of the device's 
internal state that causes a change of display on an operating screen to ensure the controller and the 
device can share the same state information. Such network control system is herein achieved with 
simple structure and small transmission load on a communication path. 

DISCLOSURE OF THE INVENTION 
[0010] A first aspect of the present invention is directed to a network control system in which a first 
unit and a second unit are connected to each other a transmission path and a controller included in 
the first unit controls a device in the second unit through the transmission path. At least one of the 
first unit and the second unit handle at least one of video, audio, and information. The device has 
screen display data for displaving an operating screen of the device and identification information for 
identifying the screen displav data. The device further transmits the screen display data and the 
identification information to the controller through the transmission path. The controller comprises 
a user interface including display means, receives the screen display data and the identification 
information from the device through the transmission path, and displays the operating screen on the 
display means using the screen display data. In response to an operation by a user to the operating 
screen, the controller controls the device by transmitting operation information indicative of the 
operation and the identification information to the device through the transmission path, pathr 

at leas t on e of th e first unit and th e s e cond uni t b e ing fo r handling a t l e as t on e of vid e o, audio, 

and informati o n, 
th e d e vic e 
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having scr e en dis p lay data fo r displaying an o per ating scr ee n of the d e vice and id e ntificati o n 

informati o n for id e n t i^ing the screen display data; and 

t r ansmi t ting th e sc re en display data and th e id e n t ification informa t i o n to th e cont r oll er through 

t h e t r ansmission p ath, and 
th e cont ro lle r 

c o mprising a use r interfac e including dis p lay m e ans; 

r e c e iving th e scr ee n display da t a and t he id e nt i fication information from th e d e vic e tlir o ugh 

th e transmission path; 

displaying th e o per a t ing sc ree n on t h e dis p lay m e ans using the sc ree n dis p lay da t a; and 

in re s p ons e to an op e ration by a user t o th e o per a t ing scr e en, con tr olling th e d e vic e by 

transmitting op er ation info r mation indicativ e of th e op er ation and th e id e ntificati o n information t o 
th e d e vic e thr o ugh t h e t ransmission path. 

[0011] A second aspect of the present invention is directed to a network control system in which a 
first unit and a second unit are connected to each other a transmission path and a controller included 
in the first unit controls a device in the second unit through the transmission path. At least one of the 
first unit and the second unit being for handling at least one of video, audio, and information. The 
device has screen display data for displaying an operating screen of the device and identification 
information for identifying the screen display data, and transmits the screen display data and the 
identification information to the controller through the transmission path. The controller comprises 
a user interface including display means, receives the screen display data and the identification 
information from the device through the transmission path, and displays the operating screen on the 
display means using the screen display data and the identification information. In response to an 
operation by a user to the operating screen, the controller controls the device by transmitting 
operation information indicative of the operation and the identification information to the device 
through the transmission path, path: 

at l e ast on e of the first unit and t h e s e cond unit b e ing for handling at l e ast one of vid e o, audio; 

and information, 
th e d e vic e 

having scr e en display da t a fo r displaying an ope r ating sc r e e n of th e devic e and id e ntification 
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inf o rmation for id e n t ifying th e scr e en display data; and 

transmitting th e scre e n display da t a and t he iden t ifica t ion information to th e cont r oll er t hr o ugh 

th e t ransmission p ath; and 
th e c o ntroller 

comp r ising a us e r interface including display m e ans; 

re c e iving th e scr e en dis p lay da t a and the iden t ification informa t ion from the devic e through 

the transmission path; 

displaying th e o perating scr ee n on t h e display means using th e scr ee n display da t a and th e 

identification information; and 

in r e spons e to an op er ation by a us e r t o th e operating sc r een, cont r olling th e d e vic e by 

tr ansmi tt ing ope ration iitforma t ion indicative of t he op e ration and th e id e ntifica t ion informati o n t o 
th e d e vic e through th e transmission p ath, 

[0012] According to the first or second aspect of the present invention, by identifying the screen 
display data with the identification information, the device can easily and reliably recognize to which 
screen display data the user operation information sent by the controller is directed, thereby 
preventing erroneous operation of the device. Further, according to the first or second aspect, the 
controller manages the screen display data representing the operating screen of the device, and 
transmits the operation information based on the user's operation. However, the controller does not 
have to understand the meaning of the fianction of the device or the operation (the relation between 
the operation and the fianction of the device). In other words, user interface information (screen 
display data, operation information, etc.,) is managed and processed by the controller, while control 
information directly related to device control (information indicating the fiinction of the device, 
information indicating the relation between the fianction of the device and the operation, etc.,) is by 
the device. Therefore, the processing in the controller is reduced, and the types of operation for 
controlling the device by the controller are not limited but can be varied. Furthermore, according to 
the first or second aspect, the controller obtains the screen display data representing the operating 
screen of the device and the identification information from the device and displays the operating 
screen of the device using the obtained data and information. Therefore, even if the device has a new 
fiinction that cannot be presently assumed, only by sending the screen display data corresponding the 
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new function from the device to the controller, the new function can be easily provided for and is 
made available to the user, 

[0013] According to a third aspect of the present invention, further to m the first or second aspect, 
the identification information includes version information indicating a version of the screen displav 
data, aspect: 

th e id e ntification information includ e s version info r mation indicating a v er si o n of th e sc ree n 

display data. 

[0014] According to the third aspect of the present invention, the identification information obtained 
by the controller from the device includes the version information. Therefore, the controller can 
detect a change in the operating screen information of the device, and thereby can easily detects that 
the state of the device is changed based on instructions from other controller or voluntary change in 
the device. Further, according to the user's operation, the version information of the screen display 
data representing the operating screen is sent with the operation information to the device. 
Therefore, the device can easily and reliably understand to which operating screen the operation is 
directed, thereby executing the operation desired by the user. Further, according to the third aspect, 
when receiving the screen display data, the controller checks the version information thereof, and 
updates display only when the version information is correctly updated. Therefore, it is possible to 
reduce a load on the controller when the same screen display data is transmitted again and again. 
[0015] According to a fourth aspect of the present invention, further to m the first or second aspect, 
the operation information includes an operating position information indicative of an operating 
position on the operating screen, aspect: 

th e op e ration informat i on includes an op er ating position information indicativ e of an op e rating 

po sition o n th e o perating scr ee n. 

[0016] According to the fourth aspect of the present invention, the operation information that is sent 
to the device according to the user's operation includes the operating position information indicating 
the operating position on the operating screen. Therefore, in the operation to the operating screen, 
a desired operating position can be directly specified by a pointing device. Thus, operability for 
device control is improved. 

[0017] A fifth aspect of the present invention is directed to a network control system in which a first 
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unit and a second unit are connected to each other a transmission path and a controller included in 
the first unit controls a device in the second unit through the transmission path. At least one of the 
first unit and the second unit handle at least one of video, audio, and information. The device has 
screen display data composed of a plurality of partial screen display data for displaying an operating 
screen of the device and transmits the partial screen display data to the controller through the 
transmission path. The controller comprises a user interface including display means, receives the 
partial screen display data fi'om the device through the transmission path and displays the operating 
screen on the display means using the partial screen display data. In response to an operation by a 
user to the operating screen, the controller controls the device by transmitting operation information 
indicative of the operation to the device through the transmission path. 
path; 

at l e ast on e o f t he first unit and th e s e cond uni t being fo r handling at least on e of vid e o, audio, 

and inf o rmati o n, 
t h e d e vic e 

having scr ee n display data compos e d of a plu r ality of p ar t ial scr ee n display data for displaying 

an o p e rating scr ee n o f th e d e vic e ; and 

t r ansmitting th e p artial sc re en display da t a t o the con tr olle r th r ough the tr ansmission pa t h, and 

th e controll e r 

comprising a us e r int e rfac e including dis p lay m e ans; 

r e c e iving th e partial scr ee n display da t a from t h e d e vic e through th e t r ansmission p ath; 

displaying th e op e rating scr e en on t h e display means using t h e p a r tial sc ree n d i s p lay da t a; and 

in r e sp o ns e t o an o pe ration by a us er to th e op e rating sc ree n, controlling th e d e vic e by 

transmi tt ing ope ration information indicativ e of the op e ration to t h e devic e th r ough the tr ansmissi o n 

— j-i- 
patn. 

[0018] According to the fifth aspect of the present invention, the screen display data can be 
constructed of a plurality of partial screen display data obtained by dividing the screen, thereby 
reducing the data amount to be transferred. 

[0019] According to a sixth aspect of the present invention, fiirther to in the fifth aspect, when the 
screen display data of the device is changed, the device transmits changed partial screen display data 
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of the screen display data to the controller. Further, the controller receives the changed partial screen 
display data from the device through the transmission path and, based on the received partial screen 
display data, updates the operating screen displayed on the display means, asp e ct. 

when t he sc r een dis p lay data of th e devic e is chang e d, th e devic e transmits chang e d partial 

scr e en display data o f th e scr ee n dis p lay data to th e con tr olle r ; and 

th e controll e r r e c e iv e s th e chang e d partial scr ee n display data from the d e vic e thr o ugh th e 

t r ansntissi o n path and, bas e d o n th e r e c e ived partial scr ee n display data, updat e s the op e rating scr e en 
dis p lay e d o n the display means. 

[0020] According to the sixth aspect of the present invention, when the screen display data of the 
device is changed because the state in the device is changed, for example, only the partial screen 
display data including the changed display element is sent to the controller. Therefore, the data 
amount to be transferred to the controller on change of screen display is reduced, and the processing 
in the device and controller is simplified. 

[0021] According to a seventh aspect of the present invention, further to m the fifth aspect, the device 
has partial screen identification information for identifying the partial screen display data, and 
transmits the partial screen display data and the partial screen identification information to the 
controller through the transmission path. The controller receives the partial screen display data and 
the partial screen identification information from the device through the transmission path, aspect: 
th e d e vic e 

has pa rt ial scr ee n id e n t ification informa t ion for iden t i f ying t h e partial sc ree n display da t a; and 

t r ansmits th e p artial sc re en display da t a and t h e partial sc ree n identification iiiformation to th e 

c o n tr olle r thr o ugh the t r ansmission p a t h, and 
the controll e r 

re c e ives the p a rt ial sc ree n display data and the partial sc r e e n iden t ification information from 

th e devic e thr o ugh the t r ansmission path. 

[0022] According to an eighth aspect of the present invention, further to m the seventh aspect, when 
the screen display data of the device is changed, the device transmits changed partial screen display 
data of the screen display data and the partial screen identification information of the partial screen 
display data to the controller. Further, the controller receives the changed partial screen display data 
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and the partial screen identification information of the partial screen display data from the device 
through the transmission path and, based on the received partial screen display data and partial screen 
identification information, updates the operating screen displayed on the display means, aspect: 

— wh e n th e sc ree n dis p lay da t a of t h e d e vice is changed, th e d e vic e transmits changed pa r tial 

scr e en display data o f t h e sc r e e n dis p lay da t a and th e p a r tial sc r een identificati o n information o f t h e 
pa r tial scr ee n display data to th e con tr oll er , a n d 

th e controll e r r e c e iv e s th e chang e d p a r tial scr ee n display data and th e partial scr e en 

id e n t ificati o n inf o rmation of th e pa r tial sc ree n dis p lay data from th e d e vic e through th e transmission 
p ath and, bas e d o n th e r e ceiv e d par t ial scr ee n display data and partial scr ee n id e ntificati o n 
inf o rmation, updat e s th e op e rating scre e n displayed on t h e display m e ans. 

[0023] According to the eighth aspect of the present invention, when the screen display data of the 
device is changed, not only the partial screen display data including the change display element but 
also its partial screen identification information is sent to the controller. Therefore, the controller can 
easily specify the changed partial screen display data, thereby reducing a processing load such as 
updating the display of the operating screen on change of the screen display data. 
[0024] According to a ninth aspect of the present invention, fijrther to m the seventh aspect, in 
response to an operation by a user to the operating screen, the controller controls the device by 
transmitting operation information indicative of the operation and the partial screen identification 
information corresponding to the operation to the device through the transmission path, aspect: 

in r e sponse to an op er ation by a us er t o t he o per ating sc ree n, th e cont r oll e r c o nt ro ls th e 

d e vic e by t r ansmitting o pe ration information indicativ e of t h e op e ration and th e p artial scr ee n 
id e ntification information cor re sponding to t he op er a t ion t o the d e vic e thr o ugh th e transmission path. 
[0025] According to the ninth aspect of the present invention, in response to an operation from the 
user, the operation information and the partial screen identification information corresponding to the 
operation are transmitted to the device. Therefore the device can easily and reliably recognize to 
which partial screen display data the operation information transmitted to the device is directed, 
thereby preventing erroneous operation of the device. 

[0026] According to a tenth aspect of the present invention, fijrtherto in the seventh or ninth aspect, 
the partial screen identification information includes version information indicating a version of the 
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partial screen display data, aspect: 

th e partial scr ee n id e ntificati o n info r mation includes v e rsion informa t i o n indicating a v e rsi o n 

o f th e partial scre e n display data. 

[0027] According to the tenth aspect of the present invention, the partial screen identification 
information, which is sent to the controller together with the partial screen display data when the 
screen display data of the device is changed, includes version information. Therefore, the controller 
can prevent erroneous display of the operating screen by using this version information. Furthermore, 
in response to an operation from the user, the version information of the partial screen display data 
corresponding to the operation is sent to the device together with the operation information. 
Therefore, the device can easily and reliably know the operation by the user, thereby executing the 
operation as the user desires. 

[0028] According to an eleventh aspect of the present invention, fijrther to m the seventh or ninth 
aspect, one displav element in screen display is arranged in anv one of a plurality of displav parts 
corresponding to the plurality of partial screen display data, aspect; 

o n e display e l e m e nt in sc r een display is a rr ang e d in any on e of a p lu r ality of display parts 

c o rr e sp o nding to th e p lu r ali t y of p a r tial sc re en display da t a. 

[0029] According to the eleventh aspect of the present invention, if any one of the display elements 
on the operating screen is changed, only the partial screen display data of that display element is sent 
fi*om the device to the controller, and the plurality of partial screen display data do not have to be 
sent. Therefore, the data amount to be transferred to the controller on change of screen display is 
reduced, and also the processing in the device and controller is simplified. 

[0030] According to a twelfth aspect of the present invention, further to in the seventh or ninth 
aspect, a displav element corresponding to each operation by the user is arranged in anv one of a 
plurality of display parts corresponding to the plurality of partial screen display data, aspect: 

a display e l e m e nt co rre s p onding to e ach op er a t ion by t h e us e r is arrang e d in any one o f a 

plurality o f display p a r ts co rre s p ondi n g to th e plurali t y of par t ial scr ee n display data. 
[0031] According to the twelfth aspect of the present invention, the display element corresponding 
to each operation by the user is arranged in any one of the plurality of display parts corresponding 
to the plurality of partial screen display data. Therefore, when, in response to the operation from the 



9 



user, the operation information and the partial screen identification information corresponding to that 
operation are sent to the device, the device can easily recognize the user operation from the partial 
screen identification information. 

[0032] A thirteenth aspect of the present invention is directed to a network control system in which 
a first unit and a second unit are connected to each other a transmission path and a controller included 
in the first unit controls a device in the second unit through the transmission path. At least one of the 
first unit and the second unit handle at least one of video, audio, and information. The device has 
screen display data for displaying an operating screen of the device and overlap displav data for 
overlap display on the operating screen and transmits the screen display data and the overlap display 
data to the controller through the transmission path. The controller comprises a user interface 
including displav means, receives the screen display data and the overlap display data from the device 
through the transmission path, and displays the operating screen on the display means using the screen 
display data, and carries out overlap display on the operating screen displayed on the display means 
by using the overlap display data. In response to an operation by a user to the operating screen, the 
controller controls the device by transmitting operation information indicative of the operation to the 
device through the transmission path, path: 

a t l e ast o n e of the fi r st unit and th e s e cond uni t b e ing fo r handling at l e ast one of vid eo , audio, 

and inf o rmati o n, 
th e d e vic e 

having sc r e e n display data for dis p laying an o per a t ing sc r e e n of the d e vic e and ove r la p display 

data f or o v e rlap dis p lay o n t h e o p e r ating sc ree n; and 

t r ansmitting t h e sc r e e n dis p lay data and t h e ov er la p display da t a t o the cont r oller through t h e 

transmission path, and 
t h e cont ro lle r 

comprising a us e r int er face including display m e ans; 

r eceiving the sc re en dis p lay da t a and t he ov er lap d i splay data from the d e vice thr o ugh t he 

tr ansmission path; 

dis p laying the op e r ating sc ree n on th e dis p lay m e ans using the scr ee n display da t a, and 

carrying o ut ov e rlap display o n th e op er a t ing sc r een display e d on the dis p lay m e ans by using t h e 
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o v e rlap di&pld)/ Jala, and 

in r e s po ns e to an o peration by a us e r to th e op e rating scr ee n, cont r olling th e device by 

t r ansmi tt ing o per ation information indicativ e of th e ope r ation to th e d e vice through th e t r ansmission 

- .t-i- 
patn. 

[0033] According to a fourteenth aspect of the present invention, further to in the thirteenth aspect, 
the overlap display data is cursor information for displaying a cursor indicative of a position of 
operation bv the user to said operating screen, aspect: 

th e o v er lap display da t a is cursor informati o n f or displaying a cursor indicativ e of a p o si t ion 

o f op e ration by th e user to said op e rating scr ee n. 

[0034] According to a fifteenth aspect of the present invention, further to in the fourteenth aspect, 
the cursor information includes position information indicative of a position of the cursor on the 
operating screen, aspect. 

th e cursor informa t ion includes posi t ion informa t ion indicative of a p osition o f the cu r s o r on 

t h e o per ating scr ee n. 

[0035] According to a sixteenth aspect of the present invention, further to tn the fourteenth aspect, 
the cursor information includes shape information indicative of a shape of the cursor, aspect: 

th e curs o r informati o n includ e s shap e inf or ma t i o n indica t iv e of a sha pe o f th e cu r s or . 

[0036] According to the sixteenth aspect of the present invention, with cursor shape information 
being set, it is possible to conform the design of the cursor to the design of each display element on 
the operating screen. 

[0037] According to a seventeenth aspect of the present invention, flirther to rn the fourteenth aspect, 
the cursor information includes size information indicative of a size of the cursor, aspect: 

th e curs o r information includ e s siz e informa t ion indicativ e of a siz e of th e cu r so r . 

[0038] According to the seventeenth aspect of the present invention, with cursor size information 
being set, it is possible to conform the size of the cursor to the size of each display element on the 
operating screen. 

[0039] According to an eighteenth aspect of the present invention, further to m the fourteenth aspect, 
the cursor information includes color information indicative of a color of the cursor, aspect: 
th e cu r sor information includ e s colo r informa t ion indicative of a color of the curso r . 
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[0040] According to the eighteenth aspect of the present invention, with cursor color information 
being set, it is possible to conform the design of the cursor to the design of each display element on 
the operating screen. Furthermore, according to the eighteenth aspect, the GUI can be represented 
as supposed in the device, and thereby a GUI creator can easily convey his/her intention to users. 
[0041] According to a nineteenth aspect of the present invention, further to in the fourteenth aspect, 
the cursor information includes enable information indicating an operation that the user is allowed to 
perform, asp e ct. 

th e curs o r inf o rmati o n includ e s e nabl e information indicating an op e rati o n that th e us e r is 

allowed to p e rform. 

[0042] According to the nineteenth aspect of the present invention, when an operator carries out 
operation, whether the operation is allowed or no t is determined using enable information in the 
cursor information. Therefore, if the prohibited operation is instructed, operation information is not 
transmitted to the device, and error handling can be made in the controller, 
[0043] According to a twentieth aspect of the present invention, fiirther to in the thirteenth aspect 
when a display part corresponding to the overlap display data of the device is changed, the device 
transmits the overlap display data to the controller, and the controller receives the overlap display 
data from the device through the transmission path and, based on the received overlap display data, 
updates the operating screen displayed on the display means, aspect: 

wh e n a dis p lay p a rt co rre sponding t o t h e overlap display data of th e d e vice is chang e d, the 

d e vic e tr ansmits th e o v er lap dis p lay da t a t o t h e con tr oll er , and 

the c o ntroll er re c e iv e s t h e ov er lap display data from th e d e vic e through th e t r ansmission pa t h 

and, bas e d on t he re c e iv e d ov e rlap display data, upda te s th e o per ating scr ee n display e d on th e display 
m e ans. 

[0044] According to the twentieth aspect of the present invention, if only the overlap display data is 
changed due to an operation from the user, the device that has received the operation information 
indicative of that operation sends overlap display data to the controller, but does not send the screen 
display data thereto. Using the received overlap display data, the controller updates overlap display 
on the operating screen. Therefore, when the cursor is displayed using the overlap display data, for 
example, the data amount to be transferred is small, thereby improving a response speed to cursor 
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move operation. 

[0045] A twenty-first aspect of the present invention is directed to a network control system in which 
a first unit and a second unit are connected to each other a transmission path and a controller included 
in the first unit controls a device in the second unit through the transmission path. At least one of the 
first unit and the second unit handle at least one of video, audio, and information. The device has 
screen displav data for displaving an operating screen of the device and identification information for 
identifying the screen displav data and transmits the screen display data and the identification 
information to the controller through the transmission path. The controller comprises a user interface 
including displav means, receives the screen displav data and the identification information from the 
device through the transmission path, and displays the operating screen on the displav means using 
the screen displav data, path: 

at l e ast on e o f th e firs t unit and th e second unit being for handling a t l e ast o n e o f vid eo , audio, 

and information, 
th e device 

having scre e n display data fo r displaying an op e rating sc r e e n of the device and id e ntification 

inf o rmation for id e nti f ying th e scr ee n dis p lay da t a; and 

transmi t ting th e scr ee n display da t a and th e id e n t ification information to the contr o ll e r through 

t h e t r ansmission p ath, and 
the cont ro ll e r 

comprising a us e r interfac e including display m e ans; 

r e c e iving th e scr ee n dis p lay da t a and t h e id e n t ification information from th e d e vic e t hrough 

th e transmission path; and 

displaying th e o p e rating scr e en on th e display means using t h e scr ee n dis p lay da t a. 

[0046] A twenty-second aspect of the present invention is directed to a network control system in 
which a first unit and a second unit are connected to each other a transmission path and a controller 
included in the first unit controls a device in the second unit through the transmission path. At least 
one of the first unit and the second unit handle at least one of video, audio, and information. The 
device has screen displav data for displaying an operating screen of the device and identification 
information for idenfifving the screen display data and transmits the screen displav data and the 
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identification information to the controller through the transmission path. The controller comprises 
a user interface including display means, receives the screen display data and the identification 
information fi'om the device through the transmission path, and displays the operating screen on the 
display means using the screen display data and the identification information, path: 

at l e ast o n e of th e first unit and t h e s e cond unit b e ing for handling at l e ast o n e o f vid e o, audio, 

and information, 
th e d e vic e 

having sc ree n display data f o r displaying an op e rating scre e n of th e d e vic e and id e n t ificati o n 

informati o n f or id e nti f ying th e scr ee n display da t a; 

t r ansmitting th e sc ree n d i splay data and t h e id e ntification informa t ion t o t h e con t roll er through 

the transmissi o n p ath, and 
th e controll e r 

c o mprising a us er in ter fac e including display m e ans; 

r e c e iving t he scre e n display da t a and t h e id e n t ification information from th e devic e through 

th e t ransmission p ath; and 

displaying th e o perating scr e en on t he display means using the sc r een dis p lay data and th e 

iden t ification information. 

[0047] A twenty-third aspect of the present invention is directed to a network control system in 
which a first unit and a second unit are connected to each other a transmission path and a controller 
included in the first unit controls a device in the second unit through the transmission path. At least 
one of the first unit and the second unit handles at least one of video, audio, and information. The 
device has screen display data for displaying an operating screen of the device and overlap display 
data for overlap display on the operating screen and transmits the screen display data and the overlap 
display data to the controller through the transmission path. The controller comprises a user interface 
including display means, receives the screen display data and the overlap display data fi'om the device 
through the transmission path, and displays the operating screen on the display means using the screen 
display data, and carries out overiap display on the operating screen displayed on the display means 
by using the overlap display data, path, 

at l e ast o n e o f t h e first unit and th e s e cond uni t b e ing fo r handling a t leas t on e of vid e o, audio, 
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and iiifernia t i o n, 
th e d e vic e 

having scre e n display da t a fo r displaying an op er a t ing scr ee n of the device and o v e rlap display 

data for o verlap display on th e o p er a t ing scr e en; and 

transmi t ting th e sc ree n display data and th e ov er la p dis p lay da t a to th e controll e r through the 

transmissi o n path, and 
th e c o ntr o ll e r 

comprising a us er int e rfac e includi n g dis p lay m e ans; 

r e c e iving th e sc ree n display da t a and the ov er lap dis p lay da t a from th e d e vic e tlirough the 

transmissi o n path; and 

dis p laying the op er ating sc ree n on t he display means using th e sc r een display data, and 

carrying out o v er lap display o n th e op er a t ing sc ree n dis p lay e d on th e display m e ans by using th e 
o v e rlap display data. 

[0048] A twenty-fourth aspect of the present invention is directed to a second unit that is connected 
to each other a transmission path to a first unit including a controller and includes a device controlled 
by the controller through the transmission path. At least one of the first unit and the second unit 
handles at least one of video, audio, and information. The device has screen display data for 
displaying an operating screen of the device and identification information for identifying the screen 
display data, transmits the screen display data and the identification information to the controller 
through the transmission path, and receives the identification information of the screen display data 
and operation information indicative of an operation by a user, and operates based on the received 
identification information and operation information, path; 

a t l e ast o n e o f th e first unit and the second unit b e ing for handling at l e ast on e of video, audi o , 

and information, 
th e d e vic e 

having sc ree n display da t a fo r displaying an o p e r ating sc ree n of t h e device and iden t ifica t ion 

information for id e nti f ying th e scr ee n dis p lay da t a; 

t r ansmitting th e scr ee n dis p lay da t a and t h e i d e n t ifica t ion informa t ion to th e c o ntroller through 

th e transmissi o n path; and 
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r e c e iving the iden t ificati o n information of th e scr e en dis p lay data and o p e r ation iiifermati o n 

indicativ e of an op e ration by a user, and op er ating bas e d on the rec e iv e d id e ntification information 
and operation uiformation. 

[0049] A twenty-fifth aspect of the present invention is directed to a first unit that is connected to 
each other a transmission path to a second unit and includes a controller for controlling a device 
included in the second unit through the transmission path. At least one of the first unit and the second 
unit handles at least one of video, audio, and information. The controller comprises a user interface 
including display means, receives screen display data indicative of an operating screen of the device 
and identification information for identifying the screen display data from the device through the 
transmission path, and displays the operating screen on the display means using the screen display 
data. In response to an operation by a user to the operating screen, the controller controls the device 
by transmitting operation information indicative of the operation and the identification information 
to the device through the transmission path, p ath, 

at least o n e of t he first uni t and t h e s e cond uni t b e ing for handling at l e ast on e of vid e o, audi o , 

and information, 
th e cont r oll er 

c o m pr ising a us er int e rfac e including display m e ans; 

r e c e iving scr ee n display data indica t iv e of an op e rating sc r e e n of t h e d e vice and identification 

information for id e nti f ying t h e sc ree n d i s p lay da t a f r om t h e d e vic e t hrough th e transmission path; 

displaying the o p e r ating sc r e e n on th e dis p lay m e ans using t h e sc r e e n display da t a; and 

in r e spons e t o an op e ration by a us er t o t h e o per a t ing sc ree n, con t r o lling th e d e vic e by 

t r ansmitting o p e rati o n informa t ion indica t iv e of t h e o per ation and th e id e ntification information to 
th e d e vice through the t r ansm i ssion p ath. 

[0050] According to a twenty-sixth aspect of the present invention, further to tn the twenty-fourth 
aspect the operation information includes operating position information indicative of a position of 
operation on the operating screen, asp e ct, 

th e o per ati o n informa t ion includ e s op er a t ing position info r mation indica t iv e of a p ositi o n o f 

op e ration on th e op e rating sc ree n. 

[0051] According to a twenty-seventh aspect of the present invention, further to m the twenty-fifth 
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aspect the operation information includes operating position information indicative of a position of 
operation on the operating screen, aspect: 

th e op e ration information includ e s op e rating position information indicativ e o f a p o sition of 

oper ation o n th e ope rating sc r een. 

[0052] A twenty-eighth aspect of the present invention is directed to a second unit that is connected 
to each other a transmission path to a first unit including a controller and includes a device controlled 
by the controller through the transmission path. At least one of the first unit and the second unit 
handles at least one of video, audio, and information. The device has screen displav data composed 
of a pluralitv of partial screen displav data for displaying an operating screen of the device, transmits 
the partial screen displav data to the controller through the transmission path, and receives operation 
information indicative of an operation bv a user, and operates based on the received operation 
information, path: 

at l e ast on e of th e fi r st unit and th e second uni t b e ing fo r handling at least one of vid e o, audio, 

and information, 
the device 

having scr ee n display data com p os e d of a plu r ali t y of partial scr e en display data f or dis p laying 

an op e rating scr ee n of th e devic e ; 

t r ansmitting th e par t ial sc ree n display da t a to th e con tr oll er th r ough t h e transmission p ath; and 

rec e iving o p e rati o n information indica t ive of an ope r ati o n by a us er , and op e ra t ing bas e d on 

th e re c e iv e d ope rati o n informa t ion. 

[0053] A twenty-ninth aspect of the present invention is directed to a first unit that is connected to 
each other a transmission path to a second unit and includes a controller for controlling a device 
included in the second unit through the transmission path. At least one of the first unit and the second 
unit handles at least one of video, audio, and information. The controller comprises a user interface 
including displav means, receives a pluralitv of partial screen displav data indicative of an operating 
screen of the device through the transmission path from the device, and displavs the operating screen 
on the displav means using the partial screen displav data. In response to an operation bv a user to 
the operating screen, the controller controls the device bv transmitting operation information 
indicative of the operation through the transmission path to the device, path: 
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at l e ast o n e of the first unit and t h e s e cond unit being fo r handling at l e ast o ne of vide o , audi o , 

and informati o n, 
th e c o n tro ll er 

comprising a us e r int er face including display means; 

r e ceiving a plurality of partial sc re en display data indicative o f an o p e ra t ing screen o f the 

d e vic e tlir o ugh th e t r ansmissi o n path from t h e d e vic e ; 

dis p laying the operating scr e en on th e display means using th e partial scr ee n display data; and 

in r e sp o ns e to an o p e ra t i o n by a us e r to the op e rating scr ee n, con t r o lling t he d e vic e by 

transmitting o pe r ation information indica t iv e of the o per a t ion t hrough th e transmissi o n path to t h e 
devic e . 

[0054] According to a thirtieth aspect of the present invention, further to in the twenty-eighth aspect, 
when the screen display data of the device is changed, the device transmits changed partial screen 
displav data of the screen display data to the controller, aspect 

wh e n th e sc ree n dis p lay data of th e d e vice is chang e d, th e d e vic e transmi t s chang e d pa rt ial 

scr ee n display data of th e screen display data to th e cont r oll er . 

[0055] According to a thirty-first aspect of the present invention, further to m the twenty-ninth 
aspect, when the screen display data of the device is changed, the controller receives changed partial 
screen displav data of the screen displav data from the device through the transmission path and, 
based on the received partial screen display data, updates the operating screen displayed on the 
displav means, aspect: 

wh e n t he scr e en display data of th e d e vic e is changed, th e controll er r e c e iv e s changed partial 

scr ee n dis p lay data o f th e scr ee n display da t a from th e d e vice th r ough th e t r ansmission p ath and, 
bas e d o n th e received pa r tial sc re en d isplay da t a, updat e s the o pe rating sc ree n display e d o n th e 
display m e ans. 

[0056] A thirty-second aspect of the present invention is directed to a second unit that is connected 
to a transmission path to a first unit including a controller and includes a device controlled by the 
controller through the transmission path. At least one of the first unit and the second unit handles 
at least one of video, audio, and information. The device has screen display data for displaying an 
operating screen of the device and overlap displav data for overlap display on the operating screen. 
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transmits the screen display data and the overlap display data to the controller through the 
transmission path, and receives operation information indicating a user's operation transmitted from 
the controller, and operates based on the received operation information, path: 

at l e as t o n e of the first unit and t h e s e cond unit b e ing for handling at least on e o f vid e o, audi o , 

and informati o n, and 
th e d e vic e 

having sc ree n display da t a for dis p laying an op e rating sc r een of th e d e vic e and o verla p dis p lay 

data f o r ov er la p display on th e oper a t ing sc ree n; 

transmitting the scr ee n display data and t h e ov er lap dis p lay da t a to th e c o nt ro lle r thr o ugh t he 

transmissi o n path; and 

re ceiving o p e ration information indicating a us e r's op er ation t r ansmitt e d fr o m the con tr oll e r, 

and opera t ing based on the r ec e iv e d o p e r a t ion informa t ion. 

[0057] A thirty-third aspect of the present invention is directed to a first unit that is connected 
through a transmission path to a second unit and includes a controller for controlling a device 
included in the second unit through the transmission path. At least one of the first unit and the second 
unit handles at least one of video, audio, and information. The controller comprises a user interface 
including display means, receives screen display data indicative of an operating screen of the device 
and overlap display data for overlap display on the operating screen through the transmission path, 
and displays the operating screen of the device on the display means using the screen display data, 
and performing overlap display on the operating screen displayed on the display means using the 
overlap display data. In response to an operation by a user to the operating screen, the controller 
controls the device by transmitting operation information indicating the operation through the 
transmission path to the device , p ath, 

at l e as t on e of th e first unit and th e second unit being fo r handling at l e ast on e of vid e o, audio, 

and information, 
th e controller 

c o mprising a us e r int e rfac e including display m e ans; 

r e c e iving sc ree n dis p lay data indica t ive of an op e rating sc r een of t h e d e vic e and ov er lap 

display da t a fo r o v er la p dis p lay on t h e ope r a t ing sc ree n t hrough the tr ansmiss i on path; 
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displaying th e operating scr ee n of th e devic e on the display m e ans using th e screen display 

data, and performing ov e rla p dis p lay on the op e ra t ing sc r een display e d on th e display means using 
th e o v e rlap dis p lay data; and 

in r es po nse to an op er ation by a us er to t h e o per a t ing sc r een, cont r olling th e d e vice by 

transmitting operation information indica t ing th e o pe r ati o n t h ro ugh t he t r ansmissi o n path t o the 
devic e . 

[0058] A thirty-fourth aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
through the transmission path. The path, t he control method comprising the steps of: transmitting 
screen display data for displaying an operating screen of the device and identification information for 
identifying the screen display data from the device through the transmission path to the controller: 
displaying the operating screen on the controller using the screen display data transmitted from the 
device: and in response to an operation by a user to the operating screen, controlling the device by 
transmitting operation information indicative of the operation and the identification information from 
the controller through the transmission path to the device, oft 

transmitting scre e n display da t a fo r dis p laying an op e rating scr ee n of t h e d e vice and 

id e ntification informa t ion fo r id e nti f ying t h e sc ree n display data f r om th e d e vic e t hrough t h e 
transmission path to t he con tr oll er ; 

displaying the operating scr ee n on t h e con tr oll er using th e sc ree n display data t ransmitt e d 

from th e d e vic e ; and 

in r e sp o ns e t o a n oper ation by a us er t o t h e op er ating sc ree n, controlling th e devic e by 

transmitting op e ration information indica t ive of th e op er ation and th e id e n t ification informa t ion from 
th e controller through th e transmission pa t h t o t he devic e . 

[0059] A thirty-fiflh aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
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through the transmission path. The path, th e control method comprising the steps of: transmitting 
screen display data for displaying an operating screen of the device and identification information for 
identif^ng the screen display data from the device through the transmission path to the controller: 
displaying the operating screen on the controller using the screen display data and the identification 
information transmitted from the device: and in response to an operation by a user to the operating 
screen, controlling the device by transmitting operation information indicative of the operation and 
the identification information from the controller through the transmission path to the device, ofr 

transmitting scr ee n display data fo r displaying an op e ra t ing screen of t h e d e vic e and 

id e ntification information for id e nti f ying t he scr e en dis p lay data from th e d e vic e through th e 
t r ansmissi o n path t o the con tr oller; 

displaying th e operating screen on the controll e r using the sc r e e n display data and th e 

identificati o n inf o rmation transmitt e d from th e d e vic e ; and 

in re s p ons e to an o p e r a t ion by a us er to th e ope r ating sc ree n, con t rolling th e d e vic e by 

t r ansmit t ing o p er a t ion information indica t iv e of t h e op er ation and th e id e ntifica t i o n information from 
th e c o ntroll e r thr o ugh th e transmission pa t h to th e d e vic e . 

[0060] A thirty-sixth aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
through the transmission path. The pa t h, t h e control method comprising the steps of transmitting 
at least one of plurality of partial screen display data composing screen display data for displaying an 
operating screen of the device from the device through the transmission path to the controller: 
displaying the operating screen on the controller using the partial screen display data transmitted from 
the device: and in response to an operation by a user to the operating screen, controlling the device 
by transmitting operation information indicative of the operation from the controller through the 
transmission path to the device, ofr 

t ransmitting at l e ast one of plu r ali t y of pa rt ial scr ee n display data composing scr ee n display 

data fo r displaying an op e rating scr ee n of t h e d e vic e from the d e vice t hrough th e transmission p a t h 
t o th e c o ntr o ll e r; 
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displaying th e operating sc r e e n on th e con tr oll e r using th e partial screen display dala 

t r ansmitt e d fr o m th e d e vice; and 

in re sp o ns e to an op e ration by a us e r to th e op er ating sc ree n, controlling t he d e vic e by 

t r ansmitting operation information indicativ e of t h e op e ration from th e controll e r through the 
t r ansmission p ath to th e device. 

[0061] A thirty-seventh aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
through the transmission path. The p ath, t h e control method comprising the steps of transmitting 
screen display data for displaving an operating screen of the device and overlap display data for 
overlap display on the operating screen from the device through the transmission path to the 
controller: displaying the operating screen on the controller and performing overlap display on the 
displayed operating screen based on the overlap display data by using the screen display data and the 
overlap display data transmitted from the device: and in response to an operation by a user to the 
operating screen, controlling the device by transmitting operation information indicative of the 
operation from the controller through the transmission path to the device, oft 

transmitting sc ree n d i splay da t a for displaying an ope r ating sc ree n of th e d e vic e and overla p 

display data f o r o ve r lap display on th e op e ra t ing sc ree n from th e d e vice through th e transmission path 
to the controller; 

displaying th e ope rating sc ree n on t he controlle r and p e rforming ov er lap display on the 

dis p lay e d o pe ra t ing sc ree n bas e d on th e ov e rlap display da t a by using t he sc r e e n dis p lay data and the 
ov er lap dis p lay da t a transmitt e d from the device; and 

in r e s p ons e to an ope r a t ion hy a user t o the o p erating sc r een, controlling the d e vice by 

t r ansmitting operation information indicative of th e op er ation from t he contr o ll e r through the 
transmissi o n path to the d e vic e . 

[0062] A thirty-eighth aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
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information, and a controller included in the first unit controlling a device included in the second unit 
through the transmission path. The path, said control method comprising the steps of: transmitting 
screen display data for displaying an operating screen of the device and identification information for 
identifying the screen display data from the device through the transmission path to the controller: 
and displaying the operating screen on the controller using the screen display data transmitted fi'om 
the device, trfr 

transmitting scre e n display data for dis p laying an ope r ating scr ee n o f t h e d e vic e and 

id e ntification inf o rmation f or identi f ying th e sc r e e n display data from th e devic e through the 
transmissi o n pa t h t o the c o nt ro lle r ; and 

displaying the op e rating sc ree n on the con t roll e r using th e scr ee n display data t ransmi tte d 

fi- om th e devic e . 

[0063] A thirty-ninth aspect of the present invention is directed to a control method, in a network 
control system in which a first unit and a second unit are connected to each other a transmission path, 
at least one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
through the transmission path. The p ath, th e control method comprising the steps of transmitting 
screen display data for displaying an operating screen of the device and identification information for 
identifying the screen display data from the device through the transmission path to the controller: 
and displaying the operating screen on the controller using the screen display data and the 
identification information transmitted from the device, ofr 

transmitting sc ree n dis p lay data fo r display i ng an op er ating scr e en of the d e vic e and 

id e ntifica t i o n inf o rmati o n f or id e nti f ying t h e sc r e e n display da t a f r om th e devic e t lir o ugh th e 
transmission path to th e c o ntroll er ; and 

displaying the oper ating scr ee n on th e cont r oller using the screen display da t a and t he 

id e ntificati o n information t r ansmitted from the d e vice. 

[0064] A fortieth aspect of the present invention is directed to a control method, in a network control 
system in which a first unit and a second unit are connected to each other a transmission path, at least 
one of the first unit and the second unit being for handling at least one of video, audio, and 
information, and a controller included in the first unit controlling a device included in the second unit 
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through the transmission path. The p ath, the control method comprising the steps of: transmitting 
screen display data for displaying an operating screen of the device and overlap display data for 
overlap display on the operating screen from the device through the transmission path to the 
controller: and displaying the operating screen on the controller and performing overlap display on 
the operating screen based on the overlap display data by using the screen display data and the 
overlap display data transmitted from the device, ofr 

transmitting scre e n display data f or displaying an o per a t i n g sc r een o f t he device and ov er la p 

display da t a f o r ov e rlap display on t h e o pe r a t ing scr e en from th e d e vic e through th e transmissi o n path 
t o th e cont r oll e r; and 

displaying th e op e rating scr ee n on th e cont ro ll er and p e rforming ov er la p display o n th e 

op e rating sc r een bas e d o n the ov er la p d i s p lay data by using t h e scr ee n display data and th e overlap 
display data transmitt e d from th e d e vic e . 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0065] FIG. 1 is a block diagram showing the configuration of a device in a network control system 
according to a first embodiment of the present invention. 

[0066] FIG. 2 is a block diagram showing the configuration of a controller in the network control 
system according to the first embodiment. 

[0067] FIG. 3 is a diagram showing one example of system configuration of the network control 
system in the first embodiment. 

[0068] FIGS. 4 A - 4C are tstt diagrams showing the structure of screen information sent from a 
device to a controller in the first embodiment. 

[0069] FIG. 5 is a diagram illustrating one protocol of the network control system in the first 
embodiment. 

[0070] FIG. 6 is a diagram showing one example of an operating screen displayed on the controller 
in the first embodiment. 

[0071] FIG. 7 is a diagram illustrating another protocol of the network control system in the first 
embodiment. 

[0072] FIG. 8 is a diagram showing the structure of screen information sent from a device to a 
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controller in a second embodiment of the present invention. 

[0073] FIG. 9 is a diagram showing one example of an operating screen displayed on the controller 
in the second embodiment. 

[0074] FIG. 10 is a block diagram showing the configuration of a version manager of the device in 
the second embodiment. 

[0075] FIG, 11 is a flowchart showing the operation of the version manager of the device in the 
second embodiment. 

[0076] FIG. 12 is a diagram illustrating version information in the second embodiment. 

[0077] FIG. 13 is a diagram illustrating a protocol of a network control system in the second 

embodiment. 

[0078] FIG. 14 is a diagram showing one example of an operating screen displayed on the controller 
in a third embodiment of the present invention. 

[0079] FIG. 15 is a diagram illustrating a protocol of a network control system in the third 
embodiment. 

[0080] FIG. 16 is a diagram showing the structure of screen information sent from a device to a 
controller in a fourth embodiment of the present invention. 

[0081] FIG. 17 is a diagram showing one example of an operating screen displayed on the controller 
in the fourth embodiment. 

[0082] FIG, 18 is a diagram showing one example of an operating screen displayed on the controller 
in a modified fourth embodiment. 

[0083] FIG. 19 is a diagram showing the structure of screen information sent from a device to a 
controller in a fifth embodiment of the present invention. 

[0084] FIG. 20 is a diagram showing one example of an operating screen displayed on the controller 
in the fifth embodiment. 

BEST MODE FOR CARRYING OUT THE INVENTION 
[0085] The present invention is now described in more detail 
referring to the attached drawings. 
<First embodiment> 
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[0086] FIG. 1 is a block diagram showing the configuration of a device in a network control system 
according to a first embodiment of the present invention, and FIG. 2 is a block diagram showing the 
configuration of a controller in the network control system according to the first embodiment. The 
operation and configuration of the network system of the present embodiment are now described by 
using FIGS. 1 and 2. 

[0087] A device described herein means something to be controlled by a controller. The controller 
herein means something that it has a user interface including display means such as a video monitor 
having a graphic display fianction and operating means such as a mouse, keyboard, and TV remote 
and controller that a user operates while watching the screen of the video monitor. Note that either 
one or both of the device and the controller may exist in a single unit. Further, the device 
corresponds to one node on a transmission path, and a unit may be constructed so as to have a 
plurality of nodes in a single box. The controller and the video monitor may be different units, and 
the connection therebetween is arbitrarily determined: they may be connected in an analog manner 
or with a transmission path as shown in the present embodiment. 
<1 . 1 Device in the first embodiment> 

[0088] As shown in FIG. 1, the device in the network control system of the present embodiment 
includes a packet transmitter/receiver 2, a synchronous data transmitter/receiver 3, a device signal 
processing part 4, an asynchronous data transmitter/receiver 5 , a device asynchronous data processing 
part 6, a unit configuration information 7, an information manager 18, and a screen display data 
generator 20. The packet transmitter/receiver 2 is connected to a transmission path 1. 
[0089] The transmission path 1 is, by way of example only, a serial bus defined by IEEE 1394 
standard (IEEE 1394-1995 and standards upward-compatible therewith) (1394 bus). Note that the 
transmission path 1 is not necessarily the 1394 bus, but is implemented by using ATM, Ethernet, 
infi'ared transmission, or the like. 

[0090] The packet transmitter/receiver 2 physically and electrically interfaces with the transmission 
path 1, and also carries out arbitration of bus mastership, cycle control for synchronous transfer, and 
other processing. Further, the packet transmitter/receiver 2 selectively receives a packet on the 
transmission path 1 according to the destination and transmits the packet to the transmission path 1. 
[0091] At transmission, the synchronous data transmitter/receiver 3 manages the transfer rate (data 
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dividing) and provides a header. For example, when the 1394 bus of the AV protocol (lEC 61883) 
standard is used, the synchronous data transmitter/receiver 3 provides a CIP (Common Isochronous 
Packet) header. On the other hand, when receiving data, the synchronous data transmitter/receiver 
3 rearranges received packets in a correct order, removes the headers, and performs other processing. 
[0092] The device signal processing part 4 receives synchronous data from the synchronous data 
transmitter/receiver 3 to carry out signal processing according to the device. For example, if the 
device is a recorder/player such as a digital VCR, the device signal processing part 4 records the 
synchronous data into a recording medium (magnetic tape, for example). In addition, the device 
signal processing part 4 retrieves the synchronous data from the recording medium, broadcasting 
wave, etc., and transmits the same to the synchronous data transmitter/receiver 3. 
[0093] The asynchronous data transmitter/receiver 5 carries out asynchronous data transactions 
according to the protocol of the transmission path 1. By way of example, for the 1394 bus, read, 
write, lock transactions are performed. Here, the asynchronous data transmitter/receiver 5 may be 
implemented as software. 

[0094] The device asynchronous data processing part 6 processes the asynchronous data received 
from the asynchronous data transmitter/receiver 5, and then transfers the same to the appropriate 
component in the device. For example, if receiving a control data and user operation information 
as the asynchronous data, the device asynchronous data processing part 6 determines validity of the 
asynchronous data, and instructs a unit internal controller 9 to execute ftinctions corresponding to 
the control code and user operation information if the data is valid. Here, the device asynchronous 
data processing part 6 may transfer the control code and the user operation information to the 
information manager 1 8. In this case, the information manager 1 8 determines validity of these and, 
if valid, instructs the unit internal controller 9 to execute functions indicated by these. 
[0095] If the controller requests for the unit configuration information 7, the device asynchronous 
data processing part 6 sends, according to the request received through the asynchronous data 
transmitter/receiver 5, etc., the information in the unit configuration information 7 through the 
asynchronous data transmitter/receiver 5, etc., to the controller. Furthermore, based on the 
instruction from the unit internal controller 9, the device asynchronous data processing part 6 sends 
asynchronous data from the components in the device to the asynchronous data transmitter/receiver 
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5. Here, the asynchronous data transmitter/receiver 5 and the device asynchronous data processing 
part 6 may be constructed as a single unit. 

[0096] The unit configuration information 7 indicates information about the configuration of the 
device, being written according to the rule shown by a configuration ROM of a CSR (Command and 
Status Registers) architecture indicated by ISO/IEC 13213:1994. Ifthe 1394 bus is used, the device 
configuration information includes bus information such as whether the device supports a bus 
manager and isochronous operation, o p e r ation , unit directory including information whether the 
device supports an AV protocol and a unique ID as an identifier of the device. 
[0097] When transmitting bitmap data indicative of contents to be displayed on the screen of the 
display means of the controller as a device operating screen (hereinafter referred to as "screen display 
data") to the controller, the information manager 18 provides the screen display data with 
identification information for identifying the screen display data. Further, the information manager 
18 instructs the screen display data generator 20 to update the screen display data according to the 
instruction fi-om the unit internal controller 9. 

[0098] This identification information includes information for specifying the device (unique ID to 
the device, for example) and version information. By way of example, when the identification 
information includes version information, the information manager 1 8 is constructed using a counter 
to manage the version of the screen display data. The counter in the information manager 18 is 
incremented every time the screen information is updated by the unit internal controller 9, Here, the 
counter is an infinite cyclic counter having a sufficient finite bit length, and indicates a minimum value 
after its maximum value is incremented. The bit length of the counter is arbitrarily determined. 
Preferably, however, the bit length is sufficient enough to prevent one cycle of the counter value from 
being complete at least while the controller holds control or has access to a change of state in order 
to avoid the same counter value from indicating different screen display data. 
[0099] Further, when the screen display data is read to the controller, the counter value is also read 
thereto. The counter value indicates the version information of the read screen display data. Thus, 
the controller can confirm the version information, thereby improving reliability. 
[0100] The screen display data generator 20 generates screen display data (screen display data in a 
bitmap format, for example) indicating the operating screen for the device according to the instruction 
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from the unit internal controller 9 based on the state of the device and user operation. Here, the 
screen display data generated by the screen display data generator 20 is screen display data displayed 
on one screen of the controller. The size of the operating screen is predetermined through the 
communication between the device and the controller, standards, or the like, or written in the header 
of the screen information, etc. On the operating screen displayed using the screen display data, 
control information for controlling the device, contents information, operating state information, etc., 
are displayed. 

[0101] Here, the control information indicates an operating panel (reverse button, stop button, record 
button, etc.,) of a VCR, for example. The contents information indicates information for notifying 
the user of the contents. For an STB (set-top box), the contents information indicates information 
about a program now being broadcast, that is, a program title, title image, theme music, summary, 
cast, etc. For a DVD device, the contents information indicates the contents recorded on a disk as 
a recording medium, that is, a title, title image, theme music, summary, cast, etc. For the VCR, by 
way of example only, the operating state information indicates a display element (also called "object") 
such as display elements indicating the state of operation of the device (playing, reversing, unattended 
recording programmed). Further, information required for network control such as identification 
information of the controller that is now using the device, and time, data, and a channel number for 
unattended recording, etc., may be written in the operating state information. 
[0102] The unit internal controller 9 controls each components including the internal mechanism of 
the device; etc. If the device asynchronous data processing part 6 receives a control code indicating 
an operation of the device, the unit internal controller 9 causes the device to operate according to the 
control code as instructed by the device asynchronous data processing part 6. Also, according to a 
change of state in the device and the user operation, the unit internal controller 9 instructs the screen 
display data generator 20 to update the screen display data through the information manager 18. 
[0103] The operation of the device in response to the request from the controller, etc., is as follows. 
If the device or controller is connected to the transmission path 1, the controller first reads the unit 
configuration information 7 of the device to determine whether the device has screen display data or 
not, making a request to the device for GUI information and reading the screen display data from the 
screen display data generator 20. 
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[0104] Then, if receiving the user operation information from the controller, the device carries out 
processing indicated by the operation information according to the circumstances. 
[0105] Here, for example, when the controller transmits operating information indicating that the user 
performs "select" operation (hereinafter referred to as "operation information "select"") while 
displaying the operating screen for the device using the screen display data, the asynchronous data 
transmitter/receiver 5 reports the operation to the unit internal controller 9. The unit internal 
controller 9 provide an instruction to each component in the device according to the state of the 
screen display data. By way of example, assume that screen display data indicating that the cursor 
is displayed on the play button is transmitted from the device to the controller and the user performs 
"select" operation while the controller displays the screen display data. In this case, the device 
receives the user operation information "select", and the unit internal controller 9 recognizes, from 
the screen display data or the state of the device that has generated the screen display data, that the 
user operation indicates "play", and provides an instruction to each components in the device to start 
the play operation. 

[0106] Note that, at this time, in addition to the user operation information, the identification 
information of the screen display data being displayed by the controller when the user performed 
operation is transmitted to the device. Therefore, the device can correctly determine to which screen 
display data the user operation is directed. Such determination can be easily made even if the user 
operation becomes invalid or indicates control of another function due to a change of state in the 
device (for example, when the screen display data is totally changed). Thus erroneous operation of 
the device can be prevented. As such, if the user operation becomes invalid due to a change of 
information in the device, the device can update the screen display data and notify the user that the 
operation becomes invalid. 

[0107] As described above, in response to the request from the controller for GUI (Graphical User 
Interface) information, all the device has to do is to provide the screen display data information, 
thereby lightening the load on the device. Further, it is not necessary to define a command to each 
function of the device by standardization organizations etc. Even for a device having a new function 
that cannot be presently assumed, if screen display data compliant with the new function is sent to 
the controller, the new function can be easily presented to the user via the transmission path 1, and 
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become available to the user. Then, by specifying the function of the device using the user operation 
information and the screen display data, the user can control the device with a simple structure. 
[0108] Note that the component such as the synchronous data transmitter/receiver 3 and the device 
signal processing part 4 may be arbitrarily implemented according to the function of the device, and 
may be omitted. Furthermore, such component may be implemented as either hardware or software. 
[0109] Further, the user operation information may be encoded and then sent. Moreover, the screen 
information and the user operation information are not required to be sent or received through the 
same transmission path. By way of example, the screen information is transmitted through a 1394 
bus using a cable while the operation information by infrared rays. 
<1.2 The controller in the first embodiment> 

[0110] FIG. 2 is a block diagram showing the configuration of the controller in the network control 
system of the present embodiment. The controller includes a controller signal processing part 10, 
a controller asynchronous data processing part 11, a screen display data manager 12, a 
display/function selection part 14, and a screen display data holding part 21. Note that, in FIG. 2, 
the same components as those shown in FIG. 1 are provided with the same reference numerals, and 
their description is omitted herein. 

[0111] The controller signal processing part 1 0 receives synchronous data from the synchronous data 
transmitter/receiver 3, and carries out signal processing that is capable of being performed by the 
controller. By way of example, if the controller is capable of displaying video such as a video 
monitor, the controller signal processing part 10 decodes the synchronous data (MPEG2 stream, for 
example) for display on the screen. 

[0112] The controller asynchronous data processing part 1 1 processes asynchronous data received 
from the asynchronous data transmitter/receiver 5, and then transmits the processed data to each 
appropriate component in the controller. Furthermore, the controller asynchronous data processing 
part 11 receives, from the packet transmitter/receiver 2 through the asynchronous data 
transmitter/receiver 5, information about the device on the transmission path 1 such as connection 
of a new device and removal of an existing device, and screen display data of the device, and then 
transmits them to the screen display data manager 12. Further, according to the instruction from the 
display/function selection part 14, the controller asynchronous data processing part 11 sends 
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asynchronous data from each component in the controller to the asynchronous data 
transmitter/receiver 5. Here, the asynchronous data transmitter/receiver 5 and the controller 
asynchronous data processing part 1 1 may be constructed as a single unit. 

[01 13] Assume the controller and the device are constructed in a single unit. Since the screen display 
data of the device in the unit is generated in the unit internal controller 9, the unit has the screen 
display data of the device but the screen display data manager 12 is does not necessarily required to 
manage it. Also, in this case, the controller signal processing part 10 and the device signal processing 
part 4, and the controller asynchronous data processing part 1 1 and the device asynchronous data 
processing part 6 may be constructed as a single unit, respectively. 

[0114] The screen display data manager 12 manages screen display data information received from 
the device on the transmission path 1 . When receiving, from the controller asynchronous data 
processing part 1 1, information about new device connection, the screen display data manager 12 
instructs the controller asynchronous data processing part 1 1 to read screen display data information 
of the new device. Note that, in this case, the new device may search for the controller to 
spontaneously transmit its screen display data to the controller. 

[0115] Next, when the screen display data and its version information of the new device has been 
read, the screen display data is held in the screen display data holding part 21, and its identification 
information is stored in the screen display data manager 12 in relation to the screen display data. 
Here, the identification information includes the read version information. The identification 
information may be stored in the screen display data holding part 21 together with the screen display 
data, or may be stored and managed by the screen display data manager 12. Furthermore, when, for 
example, information about removal of an existing device on the transmission path 1 is received, the 
corresponding screen display data is deleted from the screen display data holding part 21 . Note that 
the screen display data in the controller does not have to be exactly the same in format as that in the 
device as long as they include the same information. 

[0116] The display/function selection part 14 notifies the user of the screen display data including a 
display element (video/audio/character information, etc.,) indicating a function or state of the device 
on the screen of the controller and, according to user operation, selects a device and function, and 
provides instructions of executing each function. This display/flinction selection part 14 instructs the 
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screen display data manager 1 2 to search for the screen display data and, using the screen display data 
obtained through search, causes the operating screen for an arbitrarily device on the transmission path 
1 to be displayed on the screen of the controller. Further, the display/function selection part 14 can 
display/replay data received from the controller signal processing part 10 (video and audio data, for 
example) and data received from the controller asynchronous data processing part 1 1 . At this time, 
the screen display data may be overlaid on the video data received from the controller signal 
processing part 10, or the display screens for the screen display data and for the video data may be 
switched according to a user*s instruction, etc. Further, the background of the screen display data 
may be transparent to allow display of the video data. 

[0117] If the user performs, onto the screen displayed by the controller, operation such as pressing 
a selection button on the remote controller and pressing a right-direction arrow button, the 
display/function selection part 14 issues the identification information of the screen display data and 
operation information indicative of this user operation through the controller asynchronous data 
processing part 1 1, etc. 

[0118] The display/function selection part 14 receives, as updated screen display data, a response 
from the device to the identification information and the user operation information through the 
controller asynchronous data processing part 1 1 . The identification information is managed by the 
screen display data manager 12, and the corresponding screen display data in the screen display data 
holding part 21 is updated. Further, if the identification information added to the screen display data 
as the response includes version information, the screen display data manager 12 checks the version 
information, and updates the screen display data held in the screen display data holding part 21 only 
when the version information has been correctly updated. Thus, the screen display data held in the 
controller does not have to be updated every time the same screen display data is transmitted, thereby 
lightening a load. 

[0119] In the present embodiment, the controller does not have to recognize each function of the 
device. For example, even for a device having a new function that cannot be presently assumed, the 
controller can notify the user by displaying screen display data including a display element (button, 
for example) to the new function. When, with such display element, the user understands and selects 
the new function, the display/flinction selection part 14 of the controller transmits this user operation 
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information to the device to cause the device to execute the new function. Therefore, with the above 
structure, the user can execute even a new function that cannot be presently assumed. 
[0120] Note that the components such as the synchronous data transmitter/receiver 3 and the 
controller signal processing part 10 may be omitted according to the function of the controller. 
<1.3 System structure in the first embodiment> 

[0121] FIG. 3 is a diagram showing the system structure of the network control system of the present 
embodiment. As shown in FIG. 3, the network control system includes a television receiver 
(television) 21, a television remote controller 22, a personal computer (PC) 23, a 
recordable/replayable DVD 31, a DV-format digital VCR (DVC) 32, a VHS-format digital VCR 
(DVHS) 33, a DV-format digital movie (DVC movie) 34, and a set-top box (STB) for CS digital 
broadcasting 35, which are collectively called video/audio/information devices. 
[0122] These video/audio/information devices are connected to the transmission path 1 to form a 
single network control system (such system is called "AVC system".) Note that the 
video/audio/information devices are not restricted to the above mentioned devices, but include all of 
existing devices in video, audio, and information areas (printer and mini-disc, for example) and 
devices coming in the future. 

[0123] In such system of the present embodiment, the television 2 1 is a unit composed of a controller 
and a device, and the user uses the remote controller 22 to provide instructions to the display/function 
selection part 14. The PC 23 is a unit composed of a controller and a device (modem that interfaces 
with a telephone line, video monitor, etc.,) and the user uses a keyboard, mouse, etc. to provide 
instructions to the display/function selection part 14. 

[0124] Here, the DVD 3 1 and the DVC movie 34 are units capable of recording and replaying audio 
and video data (hereinafter referred to '*AV data"). Each of the DVC 32 and the DVHS 33 is a unit 
composed of a device capable of recording and replaying AV data and a device having a function as 
a digital broadcasting tuner. The STB 35 is a device having a function as a tuner for receiving CS 
digital broadcasting. 

[0125] Here, the DVD 31, DVC 32, DVHS 33, DVC movie 34, and STB 35 are all devices. 
However, each of these units may be implemented as a unit including a controller and a device as long 
as such unit can realize, if small at all, an environment enabling the user to operate other devices 
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through a liquid crystal panel, etc., that is, for example, as long as the unit enables the user to carry 
out operation such as selecting functions of other devices with a touch panel, remote controller, etc. 
Each of these units may include a processing function as a controller with its remote controller. In 
such case, only display and audio may be displayed on a monitor through analog connection, etc., and 
the user may operate the unit through the remote controller while watching the displayed screen. At 
this time, the unit may include a controller and a device. 
<1.4 Screen display data in the first embodiment> 

[0126] FIGS. 4(a) to (c) are diagrams showing the structure of screen display information to be 
transmitted from the device to the controller in the present embodiment. FIG. 4(a) shows screen 
information using an ID as the identification information; FIG, 4(b) shows screen information whose 
identification information includes version information; and FIG. 4(c) shows screen information using 
version information as the identification information. 

[0127] First, the screen information shown in FIG. 4(a) has an identifier (ID) for identifying each 
screen display data. As such, by identifying the screen display data with the identifier, the device can 
easily and reliably recognize to which screen display data the user operation information from the 
controller to the device is directed, thereby preventing erroneous operation of the device. 
[0128] The screen information shown in FIG. 4 (b) has, as the identification information, an identifier 
(ED) for identifying each screen display data and version information. For example, if the device is 
a VCR and each of a deck part and a tuner part has a different operating screen, the device can be 
constructed as such that each operating screen is provided with an identifier, and version information 
according to changes in each operating screen. In this way, if the screen display data is identified by 
the identifier and the version information, the device can manage by classification and reliably 
recognize to which screen display data the user operation information from the controller to the 
device is directed, thereby preventing erroneous operation of the device. Furthermore, the device can 
easily manage the screen display data. Still further, even if the device resent the same screen display 
data due to problems in the transmission path, etc., the controller can easily know the fact and does 
not have to carry out unnecessary screen update, thereby reducing the processing. 
[0129] The screen information shown in FIG. 4(c) does not have an identifier (ID) for identifying 
each screen display data, but uses version information instead as the identification information. As 
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such, by using a value which sequentially changes according to the changes of the screen display data 
as the identification information, the controller and the device can easily determine manag e to which 
screen display data the user operation information from the controller to the device is directed. The 
device can thus easily know which screen display data the controller is now displaying and how much 
difference there is between the screen on the controller and the screen display data of the device. 
Further, if the screen display data transmitted from the device is missing or required to be resent due 
to problems on the transmission path, etc., the controller can easily know the fact of missing or a 
retransmission cycle to change the processing according to the degree of missing or control the screen 
display in consideration of the retransmission cycle, thereby providing a more usable display screen 
to the user, 

[0130] Note that the screen information may include in its header part type information indicating a 
type of the screen display data (for example, a format of the bitmap data), attribute information 
indicating whether the screen display data is split screen display data or not , or has version 
information or no t, size information indicating the size of the screen display data, and the like. 
[0131] Further, the physical/logical structure of the screen information which was read into the 
controller does not have to be in the same m format as that in the device as long as information that 
is valid for the screen display included in the screen information in the controller is the same as that 
in the device. In other words, the screen information does not have to physically include the header 
as shown in FIGS, 4(a) to (c), etc., as long as information such as header is managed by the 
controller. 

<1.5 Control operation in the first embodiment> 

[0132] FIG. 5 is a diagram illustrating one protocol of the network control system in the first 
embodiment. The operation for controlling the controller and the device is now described below 
using the drawing. 

[0133] First, if a device 200 is newly connected to the transmission path 1, a controller 100 on the 
transmission path 1 recognizes the new device 200 through bus reset if the bus is a 1394 bus, for 
example. On the instruction for the screen display data manager 1 2, the controller first issues a screen 
request 101 through the transmission path 1 to the device 200. Responding to the screen request 
101, the device 200 sends the screen display data and its identification information as screen 
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information 111, and the controller 100 then reads the screen information 111. Then, the screen 
display data manager 12 of the controller 100 reads and registers the screen display data to store it 
in the screen display data holding part 21 of the controller 100. 

[0134] Here, the structure may be as such that, when the new device 200 is connected to the 
transmission path 1, the device 200 spontaneously transmits the screen display data to the controller 
100. Alternatively, the structure may be as such that, when the new device 200 is connected to the 
transmission path 1 , the controller 1 00 and the device 200 communicate with each other to determine 
a transmission method of the screen display data and the device 200 transmits the screen display data 
to the controller 100 by following the method. 

[0135] The screen display data read into the controller 100 is identified by the unique ID for each 
device 200 and the identification information. For example, the screen display data has a list structure 
or directory structure with an entry for each device 200. Note that how the screen display data is 
held is arbitrarily determined. 

[0136] The display/fianction selection part 14 of the controller 100 refers to the screen display data 
in the screen display data holding part 21 through the screen display data manager 12, and displays 
the same on the display screen. Here, if the user desires to display the operating screen for another 
device 200 that is connected to the controller 100, for example, the screen display data of the devices 
200 that are connected to the controller 100 are sequentially displayed on the display screen by using 
a display switching button on the remote controller, and then the screen display data representing the 
operating screen for the desired device 200 is displayed. 

[0137] Here, if the controller 100 displays the screen display data of a specific device 200, the 
display/function selection part 14 makes a request to the screen display data manager 12 for the 
screen display data of that device 200 using the unique ID of the device 200, etc. The screen display 
data manager 12 retrieves the screen display data of the device 200 from all screen display data in 
the screen display data holding part 21, and then transmits the same to the display/fianction selection 
part 14. The display/fianction selection part 14 causes the screen display data to be displayed on the 
display screen. 

[0138] However, if the device 200 connected to the transmission path 1 is included in a device list 
of the display/fiinction selection part 14 listing connected devices, but the screen display data of that 
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device 200 is not in the screen display data holding part 2 1 , the screen display data manager 12 sends 
the screen request 101 shown in FIG. 5 to the device 200 as a command. In response, the device 200 
returns the screen information 111, The screen response 111 includes the screen display data 
indicative of the operating screen of the device 200, etc., and the identification information of this 
screen display data. The identification information includes the identifier (ID), the version 
information, etc. This version information indicates the version of the screen display data, and is 
updated every time the screen is updated. 

[0139] Note that the device list is a list that is made in the display/function selection part 14 by 
searching the transmission path 1 according to change information about the devices 200 connected 
to the transmission path 1 (a bus reset signal, for example, for reporting addition/removal) and 
detecting the connected devices 200. 

[0140] The device 200 may return only the identification information in the device 200 as the screen 
information 111. At this time, the controller 100 has to fiirther read the screen display data body 
from the device 200. However, if the controller 1 00 has cached the screen display data, for example, 
in order to transmit the same screen as that previously transmitted, the device 200 does not have to 
send the screen display data body to the controller 100, thereby reducing data amount to be 
transmitted, lightening a load on the transmission path, and simplifying the processing in the controller 
100 and the device 200. 

[0141] In this way, the screen display data manager 1 2 reads the screen display data of the device 200 
thereinto. Therefore, the display/function selection part 14 uses the screen display data manager 12 
to read out the desired screen display data from the screen display data holding part in the controller 
100, and causes the same to be displayed on the screen. Thus, the screen display data of the arbitrary 
device 200 can be displayed on the screen. 

[0142] Next, if the user operates a button on the remote controller, etc., the display/function selection 
part 14 transmits the type of the operated button, the operation ("press", "release", "select", for 
example), and the identification information of the screen display data to the device 200. In other 
words, assuming that the remote controller has arrow keys indicating upward, downward, rightward, 
and leftward directions, if the user presses the rightward direction arrow key, for example, the 
controller 100 transmits to the device 200, as an operation request 241, operation information 
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("rightward arrow key" and "press") and the identification information of the screen display data 
obtained from the device to the device 200. Therefore, the device 200 can easily and reliably 
recognize to which operating screen the operation is directed, and therefor can execute correct 
operation. If the device 200 is a pointing device 200 such as a mouse is used for the operating screen 
displayed on the controller 100, the operating information transmitted to the device 200 includes 
information indicating the operating position of the mouse, etc (hereinafter referred to as "operating 
position information"). In this case, the device 200 recognizes, from the transmitted identification 
information and operating information including the operating position information, which operation 
has been performed to which operating screen, and then executes operation corresponding to the 
recognized results. With such structure as controlling the device 200 through operation of the mouse, 
etc., the cursor can be directly moved to a desired position on the operating screen, thereby 
improving operability. 

[0143] Note that only the operation information may be transmitted to the device 200 as the 
operation request 241. In this case, although the device 200 cannot reliably recognize to which 
operating screen the operation is directed, the processing can be simplified and the traffic on the 
transmission path can be reduced. Here, the user operation information may be encoded and then 
transmitted with the identification information. Alternatively, each user operation information may 
be sent as a single command (its operand is the control code such as the ID of the screen display 
data). Furthermore, if a button allowing only selecting operation to the screen display data is pressed, 
for example, the structure may be as such that only the control code indicating this button is 
transmitted to the device 200, thereby simplifying the processing and reducing traffic on the 
transmission path 1 . 

[0144] Next, if the state in the device 200 is changed to cause the screen display data of the device 
200 to be changed, the device 200 spontaneously returns screen information 121. The screen 
information 121 includes the identification information and the screen display data, and its structure 
is similar to that shown in FIGS. 4(a) to (c). Note that the device 200 may be structured so that the 
screen information 121 becomes a secondary response to the screen request 101. At this time, the 
controller 100 receives the secondary response, and then again issues a screen request. Then, if the 
screen display data is not changed, a primary response to the screen request after the secondary 



39 



response may include only the identification information without the screen information. With such 
structure, the correspondence between the request and command can be clarified, and the processing 
of the device 200 can be simplified. 

[0145] The screen information 1 2 1 is used, by way of example only, for the device 200 to change the 
display of the operating screen into a display indicative of rewinding if automatic fast-rewinding has 
started because a tape comes to the end after replay in a VCR. Alternatively, the screen information 
may be used, by way of example only, for changing a still picture on the operating screen (from a 
convex display to a concave display) according to the operation such as pressing/releasing a button 
on the operating screen. 

[0146] After the screen display data in the controller 1 00 is updated, the screen display data manager 
12 instructs the display/function selection part 14 to update the screen display. The display/fimction 
selection part 14 updates the screen display. 

[0147] Note that, in addition to each request/response, etc, as shown in the present embodiment, 
other communications may be made between the controller 1 00 and the device 200. For example, 
although not shown, the structure may be as such that an acknowledge signal for acknowledging each 
request and response is returned. With such procedure, the controller 100 can always recognize the 
state of the device 200. 

[0148] FIG. 6 is showing one example of the operating screen displayed on the controller in the first 
embodiment. In this example, a screen display 500 represented by the screen display data transmitted 
fi-om the device is displayed as the operating screen of the VCR. Displayed on the screen display 500 
are a display element indicating that the device to be controlled is the VCR; two title images as 
contents information; reverse, play, fast-forward, pause, stop, and record buttons as control 
information; and channel up and down buttons. 

[0149] In the protocol shown in FIG. 5, the operation information and the identification information 
of the screen display data are sent from the controller 100 to the device 200 as the operation request. 
Alternatively, as shown in FIG. 7, the version information may be used instead of the identification 
information in the operation request 241. With this version information, the device 200 can 
determined to which operating screen the operation is directed, thereby obtaining the effect similar 
to that in a case where the protocol shown in FIG. 5 is used. 
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[0150] In the present embodiment, assuming that the version information of the screen display data 
is sent from the device to the controller as part of the screen information as shown in FIGS. 4(b) and 
(c), a change of state information of the device can be reported to the controller by using the version 
information, and to which screen display data the operation information from the controller is directed 
can be easily determined. Therefore, the device can change its own state information at an arbitrary 
time. In other words, even between the time the controller detects a change in the state information 
of the device and the time the controller takes in the state information, the device may change its own 
state information. Therefore, the device is not required to use a buffer for temporarily storing the 
change in the state information, thereby simplifying the processing and reducing its storage area. 
[0151] Note that the present invention is not applied only when the screen display data of the device 
is updated, but can also be applied when the controller keeps track of arbitrary screen display data 
of the device. By way of example only, the present system is effective also for a monitoring system 
for monitoring for intruders with images changed and a system for keeping track of the state of a 
device operating at a remote site. 
<1.6 Effects of the first embodiment> 

[0152] As described above, according to the present embodiment, the device has screen display data 
representing an operating screen of the device and identification information of the screen display 
data. The controller reads the screen display data and the identification information from the device. 
If the identification information includes version information, a change of the operating screen 
information of the device can be detected by the identification information. Therefore, the controller 
can easily detect that the state of the device has been changed according to an instruction from 
another controller or a change made spontaneously by the device itself Also, the controller can easily 
and reliably identify the operation information in which the state of the device has been correctly 
reflected. Moreover, the device can easily and reliably recognize to which operating screen the 
operation is directed, thereby executing the operation as the user desires. 

[0153] Further, according to the present embodiment, the controller manages the screen display data 
representing the operating screen for the device, and transmits the operation information to the device 
based on the operation by the user. However, the controller does not have to understand the meaning 
of the function of the device or the operation (the relation between the operation and the function of 



41 



the device). In other words, user interface information (screen display data, operation information, 
etc.,) is managed and processed by the controller, while control information directly related to device 
control (information indicating the function of the device, information indicating the relation between 
the function of the device and the operation, etc.,) is by the device. Therefore, according to the 
present embodiment, the processing in the controller is reduced. 
<2. Second embodiment> 

[0154] Next, a network control system according to a second embodiment of the present invention 
is described. The structures of the device and controller in the present embodiment are similar to 
those in the first embodiment, and therefore the same components are provided with the same 
reference numerals, and their description is omitted herein (refer to FIGS. 1 and 2). 
<2.1 Screen information in the second embodiment> 

[0155] FIG. 8 is a diagram showing the structure of screen information sent from the device to the 
controller in the present embodiment. In the present embodiment, the screen information is 
constructed of a plurality of partial screen information corresponding to partial screen display data 
obtained by dividing screen display data indicative of an operating screen into two or more partial 
screen displays . Each partial screen information is in a list format, including various header 
information and attribute information. However, such partial screen information does not have to be 
in a list structure. Alternatively, each partial screen information may be independent, or a screen 
information set list does not have to be required. 

[0156] Screen information 53 shown in FIG. 8 is constructed of a screen information set list 70, and 
partial screen information 61, 62, and 63. The structure of a header in the screen information is 
similar to that in the first embodiment. The screen information set list 70 is constructed of an 
identifier corresponding to the screen information 53 and a plurality of menu entries. In each menu 
entry, an identifier for each partial screen display data in the partial screen information 61 to 63 in the 
screen information 53 is set. 

[0157] Each partial screen information 61 to 63 is constructed of a header, version information, 
arrangement information, and the partial screen display data. Here, the partial screen display data is 
bitmap data for displaying a partial screen that composes part of an operating screen corresponding 
to the screen information 53. The header and version information are similar to those in the first 
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embodiment. The arrangement information is information for specifying where the partial screen 
display data is placed on the operating screen corresponding to the screen information 53, 
[0158] FIG. 9 is a diagram showing one example of the operating screen displayed on the controller 
in the present embodiment. In this example, the operating screen is constructed of four partial screen 
displays 501, 502, 503, and 504. Therefore, the screen display data representing the operating screen 
is constructed of four partial screen display data corresponding to these four partial screen displays. 
As shown in FIG. 9, in the present embodiment, the screen display data is divided into a plurality of 
partial screen display data in such a manner that a display element indicative of a single meaning to 
the user is not divided. 

<2.2 Version management in the second embodiment> 

[0159] FIG. 10 is a block diagram showing the configuration of a part in the information manager 18 
of the device carrying out management of a version of the screen display data (hereinafter referred 
to as "version manager"). The version manager in the present embodiment is constructed of a screen 
display version generator 91, an update screen display determination part 92, and a plurality of partial 
screen display version information holding parts 95, 96, 97, .... 

[0160] In the above constructed version manager, the screen display version information generator 
91 manages the version of the screen display data generated by the screen display data generator 20. 
The screen display version information generator 91 is implemented by using a counter, and obtains 
screen display update information from the unit internal controller 9 every time the screen display data 
generated by the screen display data generator 20 is changed by the information manager 18 to 
increment the counter. The counter is an infinite cyclic counter having a sufficient finite bit length, 
and indicates a minimum value after incremented to be the maximum. The bit length of the counter 
is arbitrarily determined. Preferably, however, the bit length is sufficient enough to prevent one cycle 
of the counter value from being complete at least while the controller holds control or has access to 
a change of state in order to avoid the same counter value from indicating different screen display 
data. 

[0161] The update screen display determination part 92 uses the screen display update information 
obtained from the unit internal controller 9 to detect which partial screen display data has been 
changed, and caused the partial screen display version information holding part corresponding to the 



43 



partial screen display data to store version information of the updated partial screen display data. 
[0162] The first partial screen display version information holding part 95 holds version information 
of any partial screen display data composing the screen display data indicative of the operating screen 
for the device. The version information of this partial screen display data (hereinafter referred to as 
"first partial screen display data") is, for example, version information of the partial screen display 
data in the partial screen information 6 1 shown in FIG. 8, that is, the version information constructing 
the partial screen information 61. 

[0163] The second partial screen display version information holding part 96 holds version 
information of any partial screen display data, but other than the above first partial screen display 
data, composing the screen display data indicative of the operating screen for the device. The version 
information of a second partial screen display data is, for example, version information of the partial 
screen display data in the partial screen information 62 shown in FIG. 8, that is, the version 
information constructing the partial screen information 62. 

[0164] The third partial screen display version information holding part 97 holds version information 
of any partial screen display data, but other than the above first and second partial screen display data, 
composing the screen display data indicative of the operating screen for the device. The version 
information of a third partial screen display data is, for example, version information of the partial 
screen display data in the partial screen information 63 shown in FIG. 8, that is, the version 
information constructing the partial screen information 63. 

[0165] FIG. II is a flowchart showing the operation of the version manager in the information 
manager 18 of the device. In the version manager, when the device is activated, the screen display 
version information generator 91 first initializes the version information of all partial screen display 
data, for example, setting the version information to "0" (step S701). Next, the version manager 
waits until the screen display data is changed (step S702). When the screen display data is changed, 
the screen display version information generator 91 increments the counter to update the version 
information of the screen display data (step S703). The incremented counter value indicates a screen 
display version number after update. Next, the update screen display determination part 92 detects 
using the screen display update information which partial screen display data has been changed, and 
then causes the partial screen display version information holding part concerned with the changed 
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partial screen display data to update the version information thereof. That is, the screen display 
version number is substituted into the version information of the partial screen display data, which 
is the counter value incremented of the screen display version information generator 91 (step S704). 
In this way, after the version information of the partial screen display data is updated, it is determined 
whether an instruction for ending this series of processing by the version manager is provided o r n o t 
(step S705). If not no, the procedure returns to step S702 to repeat the above series of processing 
(steps S702 to S705). While the device 200 is powered on, the procedure repeats the above series 
of processing. If it is determined yes (step S705), the series of processing ends. 
[0166] By way of example only, when the second partial screen display data is changed, the above 
version manager operates as follows. First, the screen display version information generator 91 
obtains screen display update information indicative of the change of the second partial screen display 
data from the unit internal controller 9 to increment the counter of the screen display version 
information generator 91, thereby updating the version information of the screen display data. The 
update screen display determination part 92 detects by this screen display update information that the 
changed display element belongs to the second partial screen display data, and causes the second 
partial screen display version information holding part 96 to update the version information of the 
partial screen display data. 

[0167] FIG. 12 is a diagram illustrating how the screen display data and the version information of 
each partial screen display data change. Here, assume that the screen display data indicative of the 
operating screen of the device is constructed of first to third partial screen display data. 
[0168] At the initial state, all items of the version information have been initialized. That is, the 
screen display version number and each partial screen display version number are set to "0". Here, 
if a display element of the second partial screen display data is changed, the counter of the screen 
display version information generator 91 is incremented, thereby setting the screen display version 
number and a second partial screen display version number to "1". Then, if a display element of the 
third partial screen display data is changed, the above counter is updated as such that the screen 
display version number and a third partial screen display version number are both set to "2". At this 
time, the second partial screen display version number still indicates " 1 Then, if a display element 
of the second partial screen display data is changed again, the above counter is further incremented 
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as such that the screen display version number and the second partial screen display version number 
are both set to "3". In other words, the second partial screen display version number has not and will 
not become "2". 

[0169] In this way, if any display element is changed, the counter of the screen display version 
information generator 91 is incremented, and the screen display version number and the version 
number of the partial screen display data to which the changed display element belongs are both 
updated to take the counter value after increment 
<2.3 Control operation in the second embodiment> 

[0170] FIG. 13 is a diagram illustrating a protocol of the network control system in the second 
embodiment. Using the drawing, the control operation of the controller and device is now described 
below. Note that the operation other than the control operation described below is similar to that in 
the first embodiment. 

[0171] When the device 200 is newly connected to the transmission path 1, the controller 100 on this 
transmission path 1 issues, like the first embodiment, the screen request 101 to the new device 200. 
In response, the new device 200 sends screen information 111b, and the controller 100 reads the 
screen information thereinto. At this time, the screen information 111b sent from the device 200 is 
the screen information 53 including the screen information set list 70 shown in FIG, 8. However, 
without using the screen information set list 70, all partial screen information may be sent as the 
screen information 111b. 

[0172] Then, when the user carries out operation to the device 200 through the operating screen for 
the controller 100 as a user interface, the controller 100 transmits the identification information of 
the screen display data indicative of the operating screen and the operation information indicative of 
the operation to the device 200 as the operation request 241, like in the first embodiment. At this 
time, the identification information may include version information. 

[0173] Then, if the state in the device 200 is changed and thereby the screen display data in the device 
200 is changed, the device 200 spontaneously transmits partial screen information 121b to the 
controller 100. Unlike the screen information 121 transmitted from the device 200 to the controller 
100 in the first embodiment, this partial screen information 121b is composed of the partial screen 
display data to which a changed display element belongs and its identification information. That is. 
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in the present embodiment, if the screen display data is changed, the partial screen display data to 
which the changed display element belongs is transmitted to the controller 100. In the controller 100, 
after receiving this partial screen display information 121b, the screen display data manager 12 
updates, among the partial screen display data held in the screen display data holding part 21, the 
partial screen display data indicated by the identification information of the partial screen information 
121b with the partial screen display data of the partial screen information 121b. In addition to the 
partial screen display data, the version information held in the screen display data holding part 21 is 
also updated. 

<2.4 Effects of the second embodiment> 

[0174] In the present embodiment, as shown in FIG. 9, the screen display data is divided into a 
plurality of partial screen display data in such a manner that a display element indicative of a single 
meaning to the user is not divided. Therefore, if only a single element is changed, the plurality of the 
partial screen display data are not required to be sent. Thus, the data amount to be transferred to the 
controller when the screen display is changed is reduced, and the processing in the device and the 
controller is simplified. 

[0175] Furthermore, according to the present embodiment, an identifier is provided for each partial 
screen display data. If the screen display data is changed, the partial screen display data to which a 
changed display element belongs and its identifier are sent to the controller. Therefore, the changed 
partial screen display data can be easily specified. Moreover, at this time, the version information of 
the partial screen display data is also transmitted to the controller. With this version information, the 
controller can prevent erroneous display. 

[0176] Note that a manner of dividing the screen display data may varv varied every time the device 
changes the screen display data according to the change of the information in the device. By way of 
example, the controller always reconstructs the partial screen display data transmitted from the device 
to create a frame of screen display data. The created screen display data is stored in screen display 
data holding part 21 . Then, the partial screen display data updated by the device is superimposed on 
the screen display data held in the screen display data holding part 21 for update. With such 
structure, the device can transmit partial screen display data of an arbitrary size at an arbitrary 
position to the controller, thereby simplifying the transmission amount and the processing of the 
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controller and device. Moreover, at this time, in response to the user's operation, the controller sends 
the version information of the screen display data together with the user operation information to the 
device. 

<3. Third embodiment> 

[0177] Next, a network control system according to a third embodiment of the present invention is 
now described. Since the structure of the device and controller in the present embodiment is similar 
to that in the first embodiment, the same components are provided with the same reference numerals, 
and their description is omitted herein (refer to FIGS. 1 and 2). 

[0178] Furthermore, the structure of the screen information in the present embodiment is similar to 
that in the second embodiment (refer to FIG. 8) in that the screen display data indicative of the 
operating screen of the device is composed of a plurality of partial screen display data. However, the 
present embodiment is different from the second embodiment in the manner of dividing the screen 
display data into a plurality of partial screen display data. 

[0179] FIG. 14 is a diagram showing one example of the operating screen displayed on the display 
screen of the controller in the present embodiment. In the present embodiment, the partial screen 
display data is generated for one or more display elements selected through a single operation by the 
user, that is, for every operation. The screen display data is constructed of this partial screen display 
data generated in the above described manner, and partial screen display data representing a display 
which is a base for the display elements indicated by the generated partial screen display data. For 
example, the operating screen shown in FIG. 1 4 is constructed of a plurality of partial screen displays 
5 1 1 to 520 and partial screen display 5 1 0 which is a base for these partial screen displays 5 1 1 to 520 
(hereinafter referred to as "base screen display"). Therefore, the screen display data indicative of the 
operating screen of FIG. 14 is composed of the partial screen display data corresponding to these 
partial screen display 5 1 1 to 520. Each display element as an operation unit that corresponds to each 
of the plurality of partial screen displays 5 11 to 520 is superimposed onto the partial screen display 
510, that is, the base screen display for overlap display. 

[0180] FIG. 15 is a diagram illustrating a protocol of the network control system in the present 
embodiment. By using the drawing, the control operation of the controller and device is now 
described below. Note that the operation other than the control operation described below is similar 
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to that in the second embodiment. 

[0181] The controller 100 issues the screen request 101 to the device 200. In response, the device 
200 transmits the screen information 1 lib to the controller 100. Then, when the user carries out 
operation to the device 200 through the user interface of the controller 1 00, the controller 100 issues 
an operation request 241c to the device 200, By issuing the operation request 241c, the controller 
100 sends identification information of the partial screen display data to which a display element to 
be operated by the user belongs and operation information indicative of the operation to the device 
200. In other words, as to the operation request 24 1 c in the present embodiment, the identification 
information of the partial screen display data corresponding to the operation is transmitted to the 
device 200, instead of the identification information of the screen display data indicative of the 
operating screen. In this point, the present embodiment is different from the second embodiment. 
In the present embodiment, as shown in FIG. 14, each operation unit displayed on the operating 
screen has a one-to-one correspondence with each partial screen display data. Therefore, by receiving 
the operation request 241c, the device 200 can easily recognize the user operation included in the 
operation request 241c. In other words, in the device 200, based on the identification information 
of the partial screen display data and the operation information received as the operation request 
241c, the device asynchronous data processing part 6 instructs the unit internal controller 9 to 
execute a function that corresponds to the operation unit indicated by the identification information 
and the operation information. The unit internal controller 9 executes the function based on the 
instruction. 

[0182] Then, when the state in the device 200 is changed and the screen display data in the device 
200 is thereby changed, the device 200 spontaneously transmits partial screen information 121b to 
the controller 100. The partial screen information 121b is composed of, similarly to the second 
embodiment, the partial screen display data to which a changed display element belongs and its 
identification information. After receiving the partial screen information 121b, the controller 100 
updates, similarly to the second embodiment, the partial screen display data and its version 
information. 

[0183] According to the present embodiment as described above, the screen display data indicative 
of the operating screen is divided for every operation unit. Therefore, the device 200 can easily 
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recognize the user's operation by the identification information of the partial screen display data 
transmitted from the controller 1 00 as the operation request 241c. Note that, if the partial screen data 
is divided in such a manner that any operation unit is not divided, the device 200 can easily recognize 
the operation even if division is made not by each operation unit. This is because, although the 
operation itself cannot necessarily be specified only with the identification information of the partial 
screen display data, the type of operation can be narrowed down with the identification information. 
[0184] Further, in the present embodiment, when one display element is changed, the device 200 
transmits to the controller 100 only the partial screen information corresponding to the partial screen 
display data to which the display element belongs. Therefore, as in the second embodiment, the data 
amount to be transferred to the controller 100 with change in screen display can be reduced. 
[0185] Still fiirther, the controller by itself can also make the cursor indicative of the operating 
position to the user displayed. Therefore, the controller can manage cursor movement, thereby 
simplifying the processing in the device, reducing the transmission amount, and improving response 
to the user's operation. 
<4. Fourth embodiment> 

[0186] Next, a network control system according to a fourth embodiment of the present invention 
is now described. The structure of the device and controller in the present embodiment is also similar 
to that in the first embodiment. Therefore, the same components are provided with the same 
reference numerals, and their description is omitted herein (refer to FIGS. 1 and 2). 
[0187] FIG. 16 is a diagram showing the structure of screen information 54 sent from the device to 
the controller in the fourth embodiment of the present invention. The screen information 54 is 
constructed of a screen information set list 7 1 , main screen information 65, and cursor display element 
information 80. In the present embodiment, a cursor display element indicative of the operating 
position of the user is superimposed on the operating screen for overlap display. The operating 
screen itself corresponds to the main screen information 65, while the cursor display element to the 
cursor display element information 80. As shown in FIG. 16, the main screen information 65 is 
composed of screen display data as bitmap data indicative of the operating screen, a header including 
an identifier of the screen display data, and version information of the screen display data. The cursor 
display element information 80 is composed of cursor data as bitmap data representing the cursor 
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display element, a header including an identifier of the cursor data, version information of the cursor 
data, and position information indicative of the position of the cursor. The screen information set list 
71 is composed of a header including an identifier of the screen display data indicative of the 
operating screen, in a broad sense, including the cursor display element (broad-sense screen display 
data), a data entry to the main screen information 65, and a data entry to the cursor display element 
information 80. The identifier of the screen display data indicative of the operating screen itself is set 
as the data entry to the main screen information 65, while the identifier of the cursor data is set as the 
data entry to the cursor display element. 

[0188] FIG. 17 shows one example of the operating screen displayed on the display screen of the 
controller in the present embodiment. In this example, a cursor display element 600 is superimposed 
onto a screen display 500, which is the operating screen itself, for overlap display. Note that it can 
be thought that the broad screen display data indicative of the broad operating screen that includes 
the cursor display element 600 is composed of two pieces of partial screen display data corresponding 
to the screen display 500 and the cursor display element 600. Furthermore, the cursor position on 
the operating screen is represented by coordinate values (X and Y coordinates) taking an upper-left 
comer of the screen display 500 as the origin. 

[0189] The protocol of the network control system in the present embodiment is basically similar to 
that in the second embodiment as shown in FIG. 13. In the present embodiment, the screen 
information 1 1 lb transmitted from the device 200 to the controller 100 as a response to the screen 
request 101 is constructed as shown in FIG. 16. The main screen information 65 and the cursor 
display element information 80 correspond to different partial screen display information in the second 
embodiment. After receiving such screen information, the controller 100 displays the operating 
screen using the screen display data of the main screen information 65 and, by using the cursor data 
and position information of the cursor display element information 80, ftirther superimposes the 
cursor display element onto the operating screen for overlap display. 

[0190] If the controller 1 00 issues the operation request 24 1 , the operation information is transmitted 
to the device 200 together with the identification information of the screen display data. The 
operation information includes the operating position information indicative of the operating position 
of the cursor. The operating position information is composed of X and Y coordinates on the 
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operating screen. 

[0191] After issuance of the operation request 241, when the state in the device 200 is changed and 
therefore the screen display data in the device 200 is changed, the device 200 spontaneously transmits 
the partial screen information 121b to the controller 100, like in the second embodiment. At this 
time, in the present embodiment, as to cursor movement, only the cursor display element information 
80 shown in FIG. 16 is sent to the controller 100. After receiving, the controller 100 updates overlap 
display of the cursor display element on the operating screen based on the position information 
included in the cursor display element information 80. Therefore, according to the present 
embodiment, the response speed to cursor move operation is improved. 

[0192] Note that the bitmap data of the cursor may be transmitted only in the first response (screen 
information 1 1 lb) to the screen request, and screen information transmitted thereafter does not have 
to include the bitmap data of the cursor. Therefore, the processing can be simplified, the transmission 
amount can be reduced, and the response speed can be improved. Furthermore, the structure may 
be as such that the bitmap data indicative of the cursor is sent not from the device, but determined 
by the controller itself At this time, as to cursor movement, etc., the device transmits only the 
updated cursor position information as screen information, thereby simplifying the processing, 
reducing the transmission amount, and improving the response speed. 
<4. 1 Modified example of the fourth embodiment> 

[0193] In the above embodiment, the operating screen itself is represented by single screen display 
data. However, as in the second embodiment, the operating screen may be represented by a plurality 
of partial display screen data. FIG. 1 8 is a diagram showing one example of display of the operating 
screen in the present embodiment represented by a plurality of partial screen display data. In this 
example, the operating screen is composed of four partial screen displays 501, 502, 503, and 504, and 
a cursor display element 601 is superimposed onto this operating screen for display. Therefore, in 
this case, the main screen information 65 in the screen information 54 shown in FIG. 16 is replaced 
by a plurality of partial screen display information as shown in FIG. 8. Note that the cursor display 
element information can be considered as one type of partial screen display information. 
[0194] In this case, the structure of the cursor display element information is similar to that of the 
cursor display element information 80 shown in FIG. 16. This information in the cursor element 
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information is represented by the coordinates on the operating screen in the example shown in FIG. 
16. In this case, however, as shown in FIG. 1 8, the arrangement information is information indicating 
a relative position on the partial screen display 502 onto which the cursor display element 601 is 
superimposed for overlap display. That is, the cursor position information is represented by 
coordinate values (relative X and Y coordinates) taking the upper-left corner of the partial screen 
display 502 as the origin. 

[0195] As described above, the protocol of the network control system in a case where the screen 
display data is composed of a plurality of partial screen display data is basically similar to that in the 
third embodiment as shown in FIG. 1 5. In this case, when the user carries out operation through the 
cursor, the controller 100 issues the operation request 241c to the device 200. At that time, the 
identification information of the partial screen display data sent to the device 200 includes the 
identification information of the cursor data. For example, in the case shown in FIG. 18, in addition 
to the identification information of the partial screen display data of the partial screen display 502, 
the identification information of the cursor data of the cursor display element 601 is transmitted to 
the device 200. The device 200 executes a predetermined function based on the identification 
information of the partial screen display data received as the operation request 241c (including the 
identification information of the cursor data) and the operation information. 
[0196] Then, when the state in the device 200 is changed and therefore the screen display data in the 
device 200 is changed, the device 200 spontaneously transmits the partial screen information 121b 
to the controller 100. When the controller lOOissues the operation request 241c based on cursor 
move operation by the user, all that is changed on the operating screen is the position of the cursor 
display element. Therefore, only the partial screen information 121b including the cursor display 
element information is transmitted to the controller 100. After receiving, based on the position 
information included in the cursor display element information, the controller 100 superimposes the 
cursor display element onto the operating screen for overlap display. 
<5, Fifth embodiment> 

[0197] Next, a network control system according to a fifth embodiment of the present invention is 
now described. The structure of the device and controller in the present embodiment is also similar 
to that in the first embodiment. Therefore, the same components are provided with the same 
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reference numerals, and their description is omitted herein (refer to FIGS. 1 and 2). 
[0198] FIG. 19 is a diagram showing the structure of screen information 55 sent from the device to 
the controller in the present embodiment. The screen information 55 is constructed of, as in the 
fourth embodiment, the screen information set list 71, the main screen information 65, and cursor 
display element information 81. In the present embodiment, the cursor display element is 
superimposed onto the operating screen for overlap display. In the screen information 55, the screen 
information set list 71 and the main screen information are similar in internal structure to those in the 
fourth embodiment. The cursor display element information 81 is similar to that in the fourth 
embodiment in that a header includes an identifier, version information, and position information. 
However, instead of the cursor data as bitmap data indicating the cursor display element, the cursor 
display element information 81 has information indicative of the shape, size, and color of the cursor 
display element, and further operation enable information. In this sense, the present embodiment is 
different from the fourth embodiment. Here, the operation enable information is information 
indicative of the type of operation that the user is allowed to carry out. For example, the operation 
enable information indicates that the cursor can be moved from the present position only to upward 
and rightward directions among upward, downward, leftward, and rightward directions. 
[0199] FIG. 20 is a diagram showing one example of the operating screen displayed on the display 
screen of the controller in the present embodiment. In this example, the cursor display element 601 
is superimposed onto the operating screen itself for overlap display. Here, assuming that the screen 
with the cursor display element 601 superimposed onto the screen display 500 for overlap display is 
the operating screen in a broad sense, it can be considered that the screen display data representing 
this broad operating screen (broad screen display data) is composed of two pieces of partial screen 
display data corresponding to the screen display 500 and the cursor display element 601. 
Furthermore, although the cursor display element takes a rectangular shape in the example shown in 
FIG. 20, it may take other shapes such as circle. Note that, in the present embodiment, bitmap data 
indicative of the cursor display element does not exist, and the shape, size, and color of the cursor 
display element is determined according to information included in the cursor display element 
information 81. 

[0200] The protocol of the network control system in the present embodiment is basically similar to 
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that in the second embodiment as shown in FIG. 13. In the present embodiment, the screen 
information 1 1 lb sent from the device 200 to the controller 100 as a response to the screen request 
101 is structured as shown in FIG. 19. The main screen information 65 and the cursor display 
element information 8 1 correspond to different screen display information in the second embodiment. 
After receiving such screen information, the controller 100 displays the operating screen on the 
display screen using the screen display data of the main screen information 65, and further 
superimposes the cursor display element onto the operating screen for overlap display using the 
information about the shape, size, and color, and the position information in the cursor display 
element information 81. 

[0201] After receiving the screen information 1 lib, when the operator carries out operation to the 
device through the operating screen as a user interface in the controller 100, the controller 100 
transmits to the device 200 the identification information of the screen display data indicative of the 
operating screen and the operation information indicative of the operation as the operation request 
241. Alternatively, before transmitting the operation request 241, the controller 100 may check 
whether the user operation is allowed or not based on the operation enable information in the cursor 
display element information 81 received as the screen information 111b. As a result of this check, 
if the operation is not allowed, the controller 100 does not transmit the operation request 241 but 
carries out error handling, thereby preventing unnecessary processing. By way of example, if the 
cursor is located on contents 1 shown in FIG. 20, the operation by the leftward direction arrow key 
on the remote controller may be made invalid. Alternatively, if the user presses or releases a selection 
key on the remote controller, not "press", "release", but "select" may be sent to the device as the user 
operation information. Therefore, the processing of the device can be simplified. 
[0202] After issuance of the operation request 241, when the state in the device 200 is changed and 
therefore the screen display data in the device 200 is changed, the device 200 spontaneously transmits 
to the controller 100 the partial screen information 121b corresponding to a changed part of the 
screen display data. In the present embodiment, if the cursor display element is changed by operation 
from the user, only the cursor display element information 81 as shown in FIG. 19 is sent to the 
controller 100. After receiving, based on the position information and the information indicative of 
the shape, size, and color included in the cursor display element information 81, the controller 100 
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superimposes the cursor display element onto the operating screen for overlap display. 
[0203] As described above, according to the present embodiment, when the cursor display element 
is changed by operation from the user, the device does not have to send bitmap data such as screen 
display data to the controller, thereby improving the response speed to the user operation. 
Furthermore, by setting information indicative of the shape, size, and color included in the cursor 
display element information 8 1 , it is possible to conform the design of the cursor to the design of each 
display element on the operating screen. 
<Others> 

[0204] In each of the above described embodiments, units connected to the transmission path 1 are 
units handling at least one of video, audio, and information. However, units that do not directly relate 
to either video, audio, or information, such as air conditioner, may be connected to the transmission 
path 1 as devices to be controlled. The present invention can be applied to a network control system 
with such units connected thereto. 

INDUSTRIAL APPLICABILITY 
[0205] The present invention is applied to a network control system in which a unit connected to a 
network is operated through the network. Specifically, the present invention is suitable for a device 
control system using a graphical user interface (GUI) that supports user*s device operation through 
graphics, characters, etc., on a screen. Such system includes a network control system in which a 
plurality of AV units are connected to each other a transmission path such as a serial bus of IEEE 
1394 standard and one with a GUI controls the other units through the transmission path. 
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